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ABSTRACT 



Human intermediation is the central issue for information 
professionals who have been striving to provide better services in 
ever-changing environments. This document reports on an empirical study of 
human intermediation to explore patterns of relationships between user 
situations and tasks they request of intermediaries using the AskERIC Q&A 
Service- -an Internet-based digital reference service- -as an instantiation of 
human intermediation. The book consists of 10 chapters. An Introduction 
presents an overview of the nature of the problems addressed, research 
questions, and the structure of the book. Chapter 2, "What Do We Know about 
User Behavior in Human Intermediation, " presents an extensive review of 
literature that overviews the topic of this research. Chapter 3, "Search for 
the Optimal Approach, " reviews the general research approaches in 
conventional information retrieval (IR) and information problem solving (IPS) 
research. Chapter 4, "Methodology of the Empirical Study," describes the 
research design and procedure applied in this study. Chapters 5 through 9, 
"Tasks Requested of Human Intermediaries," "Situational Factors Association 
with the Use of Human Intermediation, " "Reasons for Using the AskERIC Q&A 
Service," "Evaluation of AskERIC Q&A Service," and "Patterns of Associations 
between Situational Factors and Tasks Requested of AskERIC Q&A Service," 
present major findings of this study with some implications for existing 
models of IR and IPS research. Chapter 5 provides the taxonomy of tasks 
requested of human intermediaries developed in this research. Chapter 6 
reports a finding of key situational factors identified by the study as 
associated with the use of human intermediation and Chapter 7 presents 
findings on reasons for using human intermediation. Chapter 8 reports 
findings concerning users' evaluation of the outcome of human intermediation. 
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Chapter 9 reports findings on associations between situational factors and 
tasks requested of human intermediaries. Chapter 10 discusses the 
implications of study findings for practices of information services and 
system design. Four appendices include forms and additional information on 
findings. (Contains 209 references.) (AEF) 
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Preface 



The phenomenon of human intermediation is ubiquitous in our everyday life. Hence, people often rely on 
other human beings in solving their information problems. Nevertheless, we do not have much theoretical 
knowledge about why and in what situations people ask for information of other human beings. 

Human intermediation is the central issue for information processionals who have been striving to provide 
better services in ever-changing environments. However, existing models and findings in library and information 
service (LIS) provide little understanding of what tasks people requests of human intermediaries or why and 
in what situations people use human intermediation. Perhaps this is because existing research had captured 
human intermediation mainly from the information professionals' rather than users 7 perspective, and therefore 
only partially the information problem solving (IPS) tasks users intend to request of human intermediaries, 
merely in the context of using a service or source without fully taking into consideration social and 
environmental situations related users 7 IPS processes. 

As a professional intermediary who has worked for a long time in a variety of settings, I noticed there exists 
some patterns of relationships between user situations and what they request of intermediaries. However, 
literature in library and information science (LIS) do not provide adequate level of theoretical explanations to 
suggest the existence of such relationships, even though it provides a large number of weak theories and 
contradictory findings on human intermediation. 

Perhaps there may be shared patterns of user situations and information behavior. If such patterns exist and 
if we could capture them in a model as information behavioral grammar, we might be able to attain a better 
understanding of human intermediation in relation to users 7 IPS processes, which may provide bases for a 
better design of information systems and services. This idea led me to undertake an empirical study of human 
intermediation to explore patterns of relationships between user situations and tasks they request of 
intermediaries using the AskERIC Q&A Service - an Internet-based digital reference service (DRS) - as an 
instantiation of human intermediation (Miwa, 2000). 




The study's findings imply that the goal model of Bandura's (1986) social cognitive theory may adequately 
explain users' IPS processes. Users' IPS processes are likely to be guided by their IPS goals (cognitively generated 
images of preferable future events) that define current information needs or goals of using human intermediation 
(standards of the outcome of current action). The findings suggest the existence of patterns of relationships 
between IPS goals and tasks users requests of human intermediaries as well as with five situational factors 
including (1) type of information users sought, (2) how user goals are generated, (3) users capacity in IPS, (4) 
evaluation score and (3) evaluation criteria. 

Patterns of relationships were also identified between goals of using human intermediation and tasks users 
requests and three situational variables of (1) whether users did self-searching before making requests, (2) 
whether users had experience in using the human intermediation, and (3) perceived level of users' IPS skill. 
Accordingly, the research identified several key situational variables of users and generated a conceptual model 
that captures relationships among them. 

While a final conclusion regarding relationships between variables awaits future research, the study helps to 
generate hypotheses to be tested in future research. The conceptual model offers an improved understanding 
of systematic relationships between user goals and tasks they request of intermediaries as well as key situational 
variables within people’s opportunistic information behavior. This improved understanding is expected to 
provide researchers with potentially important situational variables to be incorporated into future research, 
while offering practitioners guides toward better information services and system design. In addition to these 
findings and the conceptual model, the study developed two taxonomies potentially useful for future research 
and practice. “Taxonomy of Tasks Requested of Intermediaries” (Table 5-1) has potential for identifying and 
categorizing tasks requested of intermediaries for purposes of both research and practice. The taxonomy may 
help understand width and depth of users’ intentions in using human intermediation and define boundaries 
of information services. “User-Based Evaluation Criteria of the AskERIC Q&A Service” (Table &-12) has potential 
for future research in identifying associations between user goals and user value systems in a variety of settings. 
This taxonomy might have potential for evaluating current practices of information services in a variety of 
environments. 

Based on this premise, I wrote this book to share the study's findings with a wide range of researchers interested 
in human information behavior, and practitioners involved in information services and system design. 

There were a number of people associated in various ways with the advent of this book. I wish to acknowledge 
the help of the AskERIC Q&A Service and the Information Institute of Syracuse who provided necessary 
resource for the execution of the research project. Iam especially indebted to Dave Lankes and Pauline Lynch 
for their collaboration on the research project. I give special thanks to my doctoral advisor Barbara Kwasnik 
who guided me from the beginning of the dissertation research toward the successful completion. I with to 
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thank my dissertation committee members Jefferey Katser, Mike Eisenberg, and Carol Hert who shared with 
me their deep and wide knowledge in human information behavior and research methodology. I wish to 
acknowledge my doctoral colleagues Silvia Barcellos, Charmaine Barreto, John Beachboard, Wen-Yuan Hsiao, 
Jee-Yeon Lee, Nelson Massad, Chatpong Tangumanee, Claire Urfels, Stacy Veeder, Kynghue Yoon; with Martine 
Beach Board as an honoraly member for their time, intelligence, and constructive criticism which enriched 
my thinking while the research was being conducted. For many suggestions and insights, I am indebted to 
professors Robert Taylor, Jana Bradley, Marta Dosa, Liz Liddy, and former professor Robert Oddy of the School 
of Information Studies at Syracuse University. I wish to acknowledge the Graduate School of Syracuse University, 
which provided the Creative Project Grants for pretest and conduct of the research project. 

All of these people and many more have influenced the development of this book. The form and content, 
however, remains my own. As a person who does not write well in English, I wish to acknowledge with 
thanks to the text editing ability of Sue Wurster. A final note of thanks to my best friend and husband Katsuhiko 
Ichinowatari: This book would not have been possible without his support and patience. 



Makiko Miwa 
Tokyo , Japan 
September 2000 




INTRODUCTION 



CHAPTER 

ONE 



People sometimes rely on other human beings in solving their information problems. This book is based on 
an empirical study that inquired as to why and in what situations users made requests of human intermediaries 
in solving their information problems (Miwa, 2000). The study made distinctions among different kinds of 
information problem solving (IPS) tasks requested of human intermediaries. Accordingly, this research sought 
to find patterns between users' situations and the IPS tasks they requested of human intermediaries using the 
AskERIC Q&A Service - an Internet-based digital reference service (DRS) - as an instantiation of human 
intermediation. The study assumed the use of human intermediation as a particular activity encompassed 
within users’ IPS processes, and explored these processes from the users’ rather than intermediaries’ perspective. 

This chapter presents an overview of the nature of the problems addressed, research questions, and the 
structure of following chapters. 

WHY STUDY HUMAN INTERMEDIATION? 

During the 1970s’ when commercial online bibliographic information retrieval (1R) systems were first introduced 
to the public, they were mainly accessed by librarians and other professional intermediaries who performed 
searches, as part of their job, on behalf of end-users. Due to the difficulty pf learning the search skills required 
to manipulate these IR systems, the commercial online bibliographic IR systems of the time inherently limited 
end-users’ direct searching and necessitated mediation by trained professional intermediaries (Eisenberg, 1983; 
Hawkins, 1981; Mischo & Lee, 1987). 

The current widespread availability of so-called user-oriented IR systems, such as Internet search engines, 
online public access catalogs (OPACs), and CD-ROM databases, has enabled users to directly manipulate IR 
systems with minimal cost. In addition, an increased availability of full-text, numeric, and visual databases 
from a variety of media, including consumer online services and the Internet, has provided users with enhanced 
access to a variety of electronically stored information through the use of IR systems. 
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As a result, more users than ever before now have opportunities for directly searching electronically stored 
information using IR systems providing they live in an environment where direct access to a variety of IR 
systems is available. In fa a, the literature reports on the proliferation of end-user direct searching of IR systems 
in academic and medical libraries while the role of professional intermediaries has shifted from providers of 
mediated searching to trainers and assistants of end-user direct-searching (Mischo & Lee, 1987; Dalrymple & 
Roderer, 1994). Reflecting such trends, the focus of research in information retrieval (IR) seems to have shifted 
from human intermediation toward direct-searching by end-users. 

The question might be raised: Since end-user direct searching is rising, why study human intermediation now, 
when it may be a declining phenomenon? Empirical evidence suggests that the proliferation of end-user direct 
searching does not necessarily mean all users are inclined to perform direct searching. First, there are a number 
of users, typically among non-academic practitioners, such as managers, journalists and politicians, who still 
rely heavily on professional intermediaries in their use of IR systems. They are expected to do so at least for 
the near future, even though they have been provided with direct access to IR systems (Nicholas, 1995). 
Second, a great deal of literature on end-user training in using IR systems has reported the emergence among 
end-users of non-professional intermediaries who undertake information-seeking tasks on behalf of other end- 
users (Nicholas 1995; Salovaara, 1988; Arnold, 1987; Mischo & Lee, 1987; Cole & Bawden, 1996). Third, human- 
mediated digital reference services (DRSs) in the Internet environments have been proliferating - the number 
of these services has been growing and their client basis has been expanding (Lankes, 1998; Wasik, 1998). 
Thus, even though search requests of professional intermediaries might have been decreasing in traditional 
libraries, some users are still relying on a variety of human intermediation in their IPS processes. 

The goal of user-oriented IR and IPS research is to obtain deeper understanding of the information-seeking 
behavior of users so as to reflect it in the design of future information services and systems (Allen, 1996; Spink 
& Saracevic, 1997). Thus, if some users still are relying on human intermediaries, researchers should examine 
in what situations and why users make requests of human intermediaries. Through such efforts, researchers 
should be able to obtain further understanding of human IPS processes, and to find out limitations of existing 
IR systems and services. Based on the findings of such empirical research, researchers may be able to develop 
theories and implications on which to base better information services, future education and training of 
information professionals, and improved IR system design. These were the major reasons supported the need 
for this research. 



RESEARCH IN HUMAN INTERMEDIATION 

Research in user information behavior concerning human intermediation is immense in volume but limited in 
scope. First, empirical research concerning traditional reference or online search services has focused mainly 
on the service providers' point of view, while little attention has been paid to the user's perspective (Spink, 
1993; Spink & Saracevic, 1997). Second, IPS tasks requested of or performed by human intermediaries have 
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not yet been empirically examined. Even though some IPS task models have been developed for users’ self- 
searching processes (Kuhlthau, 1992; Eisenberg & Berkowitz, 1995; Marchionini, 1995), they have not yet been 
applied to categorize IPS tasks requested of human intermediaries. Hence, existing studies consider human 
intermediation as a whole without making distinctions among different kinds of tasks requested by users of 
intermediaries. Third, traditional research in information science has yet to capture the use of human 
intermediation as a part of the user’s IPS process. Instead, human intermediation has been studied as merely 
the use of a source of information without taking into consideration a full spectrum of users’ IPS processes. 
Consequently, the possible association between the use of human intermediation and users’ antecedent and 
subsequent information-seeking behavior has not yet been fully explored. Fourth, IPS and IR research have 
yet to capture the full spectrum of users’ situational factors possibly associated with their use of human 
intermediation. Researchers who take cognitive and/or constructive perspectives have tried to capture users’ 
dynamically changing situations during their IPS processes (Kuhlthau, 1992). However, most of these researchers 
tend to concentrate on internal states (e.g., cognitive and/or affective) rather than external situations (e.g., 
social and/or environmental). Fifth, user behavior with respect to Internet-based human-mediated DRSs has 
not yet been well studied. 

These limitations suggested that this study should be designed as an exploratory investigation of the 
phenomenon of human intermediation as seen from a users’ perspective. 

CONTEXT OF THE STUDY 

Contrary to existing research, this study took users’ perspective, made distinctions among different tasks 
requested of the human intermediaries, and tried to explore users’ IPS processes as part of the users’ situations. 
This study also sought patterns of associations between users’ dynamically changing situations and the tasks 
they requested of the human intermediaries. The study recruited clients of the AskERIC Q&A Service to explore 
the phenomenon. 

USERS’ PERSPECTIVE 

Even though a great deal of literature has reported on help provided in end-user direct-searching of IR systems 
and tasks performed by professional intermediaries, findings were mostly based on the perspective of 
information professionals. Many researchers have investigated mediated search processes at a library reference 
service (Ingwersen, 1982) or when using online IR systems (Fenichel, 1981; Fidel, 1991; Saracevic, et al., 1988; 
McKibbon, et al., 1990) in order to capture patterns of search behavior of intermediaries but not of users. Some 
researchers analyzed interactive conversation between users and intermediaries in pre-search interviews 
performed as part of mediated use of IR systems. But the purposes were to develop a user model elicited 
from the intermediaries’ cognitive processes (Daniels, 1987) or to understand how intermediaries use 
information elicited from users in subsequent IR sessions performed by intermediaries (Saracevic, et al., 1991; 
Spink & Saracevic, 1997). Some researchers studied users’ IPS behavior in relation to their direct-searching of 
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particular 1R systems (Richardson, 1981; Nicholas, 1995; Cole & Bawden, 1996) and, as by-products of their 
research, reported findings on user situations that led to their use of human intermediation. However, none 
of them asked why and in what situations users seek human intermediation. 

By directly asking users, this study explicitly accounted for the reasons and situations that lead users to use 
human intermediation. 



TAXONOMY OF TASKS REQUESTED OF INTERMEDIARIES 

Research in the use of 1R systems tends to assume that searches are done entirely by users or not at all (Tague- 
Sutcliffe, 1992), but do not make distinctions among different tasks requested of human intermediaries. Some 
professional literature in library and information science (LIS), however, has provided anecdotal evidence that 
users tend to seek help of librarians in (1) search strategy formulation, (2) use of Boolean operators, (3) use 
of search commands and (4) solutions of technical problems. Fidel and Soergel (1983) identified five different 
tasks performed by human intermediaries in mediated/delegated searching of IR systems. They are: (1) query 
formulation, (2) selection of IR systems and databases, (3) interaction with 1R systems and databases, (4) 
termination of the search, and (5) post-logoff activities. 

Researchers of children’s information-seeking behavior in using libraries and IR systems have identified several 
stages in their IPS processes. Based on the findings, several researchers proposed step-wise models of IPS 
processes. They include the six-stage model of the information search process (ISP model) (Kuhlthau, 1992), 
the Big Six Model of Information Problem Solving (Big 6 Model) (Eisenberg & Berkowitz, 1995), and five 
information-seeking tasks of end-user searching (Marchionini, 1992). 

If such distinctive stages were commonly observed in IPS processes of users, it might be reasonable to assume 
that tasks requested by users of human intermediaries may correspond to some or all of these stages. Thus, 
taxonomy of tasks requested of intermediaries might be developed based on the IPS process models. This 
study intended to uncover what users requested intermediaries to do, rather than what professional 
intermediaries were actually doing, in human intermediation, in order to concentrate on the perspective of 
users. Thus, this study categorized IPS tasks requested by users of human intermediaries using as a starting 
point the Big 6 Model (Appendix B1 (1)), because it was acknowledged to be more flexible than others in 
capturing IPS processes of a variety of people in different settings (Eisenberg & Lowe, 1997). 

OBSERVATION OF USERS’ IPS PROCESSES 
THROUGH THE LENS OF HUMAN INTERMEDIATION 

This research assumed that the use of human intermediation was a particular activity encompassed within 
users’ IPS processes. Accordingly, the research tried to capture IPS processes of users’ antecedent and 
subsequent activities as part of their dynamic situations. Researchers who take user-centered perspectives have 
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been trying to capture IPS as a process. Recently, some researchers have proposed models that posit the IR 
interaction as a part of a higher-level IPS process (Hert, 1995; Kuhlthau, 1992). This study followed these 
researchers' process-oriented view of human information behavior. 

FACTORS ASSOCIATED WITH THE USE OF HUMAN INTERMEDIATION 

Most of the empirical research of IR and IPS has been conducted within a single academic environment using 
a homogeneous population such as students. In these studies, factors found to be associated with users’ IPS 
and IR behavior were limited to internal factors of users’ knowledge, thoughts and feelings (Kuhlthau, 1992; 
Allen, 1996). 

On the other hand, research on IPS behavior that discovered the operation of social and/or environmental 
factors has tended to deal with human intermediation as a source. For example, Hall (1977) proposed that 
different functions performed by users (e.g., research, planning, information operation) are directly associated 
with their parameters of value of information (e g., specificity, depth vs. breadth, timeliness, etc.), and that 
these parameters determine users’ preference of information sources such as access tools, human-mediated 
information search services, and information analysis services. Reflecting this view, the study explicitly addressed 
functions and/or roles of users as one of the social situational factors. 

The literature in decision making has suggested that managers tend to act on problems only when three basic 
conditions are met. They are (1) recognition of the existence of a problem; (2) availability of resources (e.g., 
authority, information, expertise, money, etc.); and (3) external pressure (e.g., deadline, crisis, pressure from 
the boss, etc.) (McCall & Kaplan, 1990). If this theory was applicable to people other than managers, social 
situations might play an important role in users’ decisions and/or actions in IPS processes, including their use 
of human intermediation. 

In this study, participants were recruited from a sample of users who fulfilled the first two conditions: they 
had recognized the existence of a problem (i.e., information need); and they had access to potential resources 
(i.e., the Internet and human intermediaries). Thus, it was important for this research to account for external 
as well as internal situational factors that might have been associated with their use of human intermediation. 

Based on the above, this study intended to capture the manifestation of external (social and environmental) 
factors in addition to internal (cognitive and affective) factors. Thus, preliminary factors presumably associated 
with the use of human intermediation were categorized into four dimensions using two axes of internal 
(cognitive/affective) vs. external (social/environmental) aspects and of dynamic (situational) vs. static aspects, 
as presented in Table 1-1. These two axes were generated based on general theories of human behavior. The 
axis of internal vs. social/environmental aspects was based on Bandura’s (1986) social cognitive theory that 
proposed the triadic reciprocity of internal factors, external factors and behavior. The axis of situational 
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(dynamic) vs. static aspects was based on Suchman’s (1987) advocacy of situated action as the basis of 
purposeful human communication behavior. 



Table 1-1: Dimensions of Factors Associated with Users’ Selection of Human intermediation 



^ Axis Derived from Social Cognitive 

. . _ . . /~~~ — ^ Theory (Bandura, 1986) 

Axis Derived from 

Situated Action (Suchman, 1 987) ~ — ____ 


Internal 

(Cognitive/Affective) 

Factors 


External 

(Social/Environmental) 

Factors 


Situational (dynamic) Factors* 

1 


Cognitive/Affective 
Situational Factors* 


Social/Environmental 
Situational Factors* 


Static Factors 


Internal Static Factors 


Social/Environmental 
Static Factors 



• Dimensions explicitly sought in the research are in hold 



The resulting four dimensions of factors are: (1) internal situational factors; (2) external situational factors; (3) 
internal static factors; and (4) external static factors. The categorization of factors into these four dimensions 
is relative and not at all absolute. The potential factors presumably associated with the use of human 
intermediation have been identified through an extensive review of the literature as presented in Chapter 2. 

By categorizing tasks requested by users of human intermediaries and situational factors presumably associated 
with users' request of human intermediaries, this research explored patterns between users' situational factors 
and tasks they request of human intermediaries. The research also elicited static factors such as demographic 
variables of users, but used them mainly for identifying potential biases. 

INTERNET-BASED DIGITAL REFERENCE SERVICES (DRSS) 

Internet-based DRSs are question-answering services that seek to fulfill the clients’ information needs by 
receiving requests from clients and delivering responses electronically via the Internet. The intermediation 
between the users' requests and information provision can be performed either through human intermediaries 
(e.g., reference librarians, domain experts, etc.), or through an automatic interface (Lankes, 1998). Since this 
study sought to explore the use of human intermediation, the focus was on those services operated through 
human intermediaries. 

With the exponential growth of Internet-based information services, users of DRSs have also been increasing 
dramatically. Internet-based DRSs have become increasingly important as people realize the present limitations 
of search engines (such as Yahoo, AltaVista, etc.) (Lankes, 1998; Wasik, 1998). Users of the Internet-based 
DRSs, however, have not yet been well studied, with the exception of a few occasional user surveys. 

For this study, which sought to identify different tasks requested by users of human intermediaries and the 
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dynamically changing user's situations possibly associated with the generation of these requests, the Internet- 
based DRSs were ideal places to recruit respondents from whom the study data could be collected for the 
following reasons: 

1 Clients of Internet-based DRSs have direct access to the Internet, because they send requests using 
the Internet. They can perform self-searching of electronic information on the Internet by themselves 
rather than making requests of these services. Thus, they should have reasons other than physical 
accessibility to the Internet for using human intermediation. This condition does not always apply 
to users of traditional mediated online search services - some users may make requests of human 
intermediaries because they do not have direct access to IR systems. 

2 Clients of the Internet-based DRSs are relatively easy to identify because the request messages are 
accompanied by clients’ e-mail addresses to which these services can deliver responses. Thus, 
recruitment messages for the study can be readily forwarded to the clients using these e-mail 
addresses. 

3 Clients of Internet-based DRSs leave evidence of their use of human intermediation. Clients’ requests 
and resulting interactions between the clients and the intermediary are kept in digital form in the 
archives of these services. Thus, the research can have access to this evidence by tracking down 
the archives. 

4 Clients of Internet-based DRSs are expected to reflect a variety of settings. These services do not 
put severe restrictions on time and place for clients to make requests, compared to traditional face- 
to-face settings. Clients can use the service from any place where access to the Internet is available. 
They can send requests 24 hours any day of the week. They can use these services for a variety of 
purposes as long as the topic is relevant to the scope of the services. Thus, the situations of these 
clients should represent a variety of settings. This condition may not apply to conventional human- 
mediated reference services operated within an organization. 

Based <pn the above, this study chose the AskERIC Online Question-Answering Service (AskERIC Q&A Service), 
one of the Internet-based DRSs, to recruit respondents. 

RESEARCH QUESTIONS 

This research was guided by the following three questions. 

RQ1: What kinds of tasks do users request of human intermediaries ? 

This research question had two objectives: (1) to identify tasks users requested of human intermediaries from 
the users’ perspective; and (2) to develop a taxonomy of tasks requested of human intermediaries. 
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RQ2: What situational factors do users perceive to be salient when they make requests of human 
intermediaries? 

This research question sought to identity internal (cognitive and/or affective) and external (social and/or 
environmental) situations of users at the moment when they decided to make requests of human intermediaries. 

RQfr Wbat patterns of associations, if any, are observed between users 9 situational factors and 
tasks requested of human intermediaries? 

This research question explored possible associations between the situational factors users perceived as 
important at the moment when they decided to make requests of human intermediaries and the tasks they 
requested of human intermediaries. 

STRUCTURE OF THE BOOK 

This book consists of ten chapters. Following this introductory chapter, the next chapter (Chapter 2) presents 
an extensive review of literature that overviews the topic of this research. By identifying key concepts and 
defining terminology, the chapter first provides a general conceptual framework. The main emphasis of the 
literature review is on the literature on information problem solving (IPS) behavior of users of information 
retrieval (1R) systems and human intermediation, as well as on efforts in integrating 1R and IPS research. 

Chapter 3 overviews the general research approaches in conventional IR and IPS research in search for the 
optimal approach for this study. The phenomenon of the use of human intermediation might have been 
investigated from a wide range of approaches because there are many models and findings relevant to it. The 
study might have been designed to explore the phenomenon by starting from scratch without taking into 
consideration existing models and findings. Or, it could have been designed to take a positivistic approach to 
test hypotheses drawn from existing models and findings. By reviewing the literature, 1 was convinced that 
existing models and findings do not provide useful hypotheses to be tested for the purpose of this study 
because these studies are limited in scope. But at the same time, I considered that ignoring these theories and 
findings might go against the cumulative nature of scientific research (Kuhn, 1996). This situation led me to 
look for a third avenue to explore the phenomenon of human intermediation in naturalistic settings, to be 
able to identify new variables, but also to utilize existing models and findings as the initial framework. 

In this chapter, three general approaches in the so called user-centered perspectives of IR and IPS research 
including cognitive, constructive and social approaches are identified. For the purpose of this study, the social 
approach was chosen because it explicitly accounts for the reciprocity of social action. Hence I consider that 
the use of human intermediation is a social phenomenon that exists not only in the mind of users but also in 
the objective world and that "there are some lawful, reasonably stable relationships" between a user's mind 
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and the objective world (Miles & Huberman, 1994, p. 4). The accountability to social situations was particularly 
important for the purpose of this study because it tired to capture human intermediation within the context 
of users’ IPS processes that might involve social and interpersonal interaction among users and between users 
and human intermediaries. 

Chapter 4 describes the research design and procedure applied in this study. Key methodological issues 
addressed are: assumptions underlying the research design, methodological challenges, research design, data 
collection and analysis techniques, and methodological limitations. The chapter argues for the adequacy of 
the naturalistic research approach taken by the study, and outlines the research activities in eliciting and 
building perspectives of users of human intermediation through iterative processes of data collection and 
analysis. Techniques applied in data collection and analysis including modified critical incident technique, top- 
down strategy of content analysis technique, and modified version of constant comparative method are fully 
described. Limitation inherent in research design including the choice of the AskERIC Q&A Service as the site 
for inviting study participants with the adequacy of sampling techniques used are also argued. 

Chapters 5 through 9 present major findings of this study with some implications for existing models of IR 
and IPS research. Chapter 5 presents the taxonomy of tasks requested of human intermediaries developed in 
this research and provides answers to the first research question. Following the presentation of the taxonomy, 
the chapter describes a full process in which the taxonomy was developed with some explanation of problems 
encountered in applying the Big 6 model in data analysis and solutions that led to the modification of the 
initial framework. An unexpected finding of discrepancies of tasks requested of intermediaries between request 
messages and interview data are described, and major sources of such discrepancies are presented with the 
description of an exploratory analysis undertaken. 

Chapter 6 reports a finding of key situational factors identified by the study as associated with the use of 
human intermediation and provides some answers to the second research question. Four dimensions of users’ 
information needs including user goals, types of information sought, perceived importance of obtaining 
information, and use biases in information needs, as well as the modification of information needs, are described 
with patterns of associations among them. Three factors associated with the generation of users’ IPS goals are 
described and discussed in their relation to time pressure and users’ freedom in IPS processes. These factors 
are compared with artifact development activities. Two variables of social functions, namely "capacity” and 
"role" in IPS are discussed with relation to users’ IPS goals. Relations between "role" and information sharing 
are also presented. 

Chapter 7 presents findings on reasons for using human intermediation and provides some answers to the 
second research question. A list of reasons elicited from interview data for using the AskERIC Q&A Service in 
users’ IPS processes is presented. Patterns of associations among reasons as identified by the analysis of casual 
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and temporal relationships between reasons are described in a graphic form. Unique patterns of relationships 
identified among reasons concerning three situational variables of (1) whether users did self-searching before 
making requests, (2) whether users had experience in using the AskERIC Q&A Service, and (3) perceived level 
of users’ IPS skill will also be reported. 

Chapter 8 reports findings concerning users’ evaluation of the outcome of human intermediation. Two 
quantitative evaluation measures of "evaluation score" users reported for the outcome of the human 
intermediation, and "satisfaction score" they reported for the use of the AskERIC Q&A Service, as well as the 
relationship of these scores are described. The evaluation criteria of the AskERIC Q&A Service, a qualitative 
evaluation framework, developed through content analysis of users’ articulation of reasons for providing a 
particular evaluation score are presented. A user-based evaluation of the AskERIC Q&A Service is presented 
with its strengths and weaknesses as seen from users. Both quantitative and qualitative evaluation are compared 
with four situational variables of users including (1) whether users did self-searching before making requests, 
(2) whether users’ had experiences in using the AskERIC Q&A Service, (3) perceived level of users’ IPS skill, 
and (4) users’ IPS goals. The chapter discusses the interesting patterns of associations identified between 
evaluation of the AskERIC Q&A Service and four situational variables of users. 

Chapter 9 reports study findings on associations between situational factors and tasks requested of human 
intermediaries, and provides answers to the third research question. Associations identified between multiple 
levels of user goals and tasks requested of intermediaries are presented. Associations between user goals and 
situational factors reported in previous four chapters are summarized. The chapter concludes with a graphical 
presentation of a conceptual model developed through synthesis of associations between user goals, situational 
factors and tasks users requested of human intermediaries. 

Chapter 10 discusses the implication of study findings for practices of information services and system design. 
After addressing issues in limitations of the study’s findings in informing to practices, their implications for the 
AskERIC Q&A Service and the ERIC system are discussed. Implications for human intermediaries and 
information system design are also argued with some suggestions for improving existing services and systems. 
The chapter concludes with the description of future research that is necessary to improve transferability of 
study findings and generalizability of the conceptual model of human intermediation developed in this study 
based on a users’ perspective. 
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CHAPTER 

TWO 



WHAT DO WE KNOW 
ABOUT USER BEHAVIOR 
IN HUMAN INTERMEDIATION 



This chapter will provide an overview of the topics I consider relevant for this research. The main emphasis 
of the literature review is on the literature on information problem solving (IPS) behavior of users, especially 
human intermediation in relation to the use of information retrieval (IR) systems. 

The literature review addresses: 

• The characteristics of tasks performed in IR and IPS processes that provide a framework to view 
the use of human intermediation as a particular activity encompassed in these processes, and 

• Potential factors that might be associated with the generation of the use of human intermediation 
within the context of naturally occurring IR and IPS processes. 



CONCEPTUAL FRAMEWORK 

In this section, major concepts central to this study are identified with some definitions of the important 
terminology used throughout this book. There are several different perspectives on and approaches to IR and 
IPS research within the field of information science. Traditionally, IR and IPS have been studied from the point 
of view of information professionals, such as librarians and information specialists, who provide information- 
related services to users. Though recent library and information science (LIS) research has shifted its focus 
toward the users’ perspective (Dervin & Nilan, 1986 ; Suger, 1995 ), the literature tends to concentrate on users’ 
self-searching processes. Accordingly, literature on human intermediation as seen from users’ perspectives is 
limited. In addition, human IPS behavior, the domain of this study, is currently a focus of research in various 
fields external to information science, including psychology, philosophy, consumer research, management, 
economics, communication, mathematics, semantics, linguistics, ethno methodology, computer science, etc. 
(Savolainen, 1993 ). Such diversity inevitably introduces serious terminological confusion - several different 
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terms represent a similar concept, while a single term means different concepts when viewed from different 
perspectives, depending upon the researcher and the field of study. To avoid such confusion, this section 
defines key terms as they are introduced. Thus, most of the definitions in this section are uniquely developed 
for the purpose of this study based on synthesis of the literature, unless stated otherwise with reference to a 
particular literature. 

INFORMATION PROBLEM SOLVING (IPS) 

AND INFORMATION RETRIEVAL (IR) 

Information retrieval (IR) should be viewed in the broader context of users' information problem solving (IPS) 
process (Hert, 1997; Nicholas, 1995; Kuhlthau, et al., 1992). Before looking into the relationship between IR 
and IPS, several terms should be defined for the purpose of this study. They are: information retrieval (IR) 
systems, information retrieval (IR) interaction, information retrieval (IR) sessions and information problem 
solving (IPS). 

A general concept of information retrieval is concerned with locating all kinds of desired information (Meadow, 
1991). Therefore, the term information retrieval (JR) system is sometimes used to represent a variety of devices 
interposed between users of information and a collection of information sources. Consequently, an IR system 
may include such devices as a library catalog, indexing and abstracting journals and printed directories. In this 
study however, IR system refers to the computer system used to locate electronically stored digital information. 

Traditional IR systems dealt mostly with static and textual information. That is, indexes and records are in text 
format and the content of each record does not change once added to the database. Reflecting the increasing 
availability of electronically stored visual information, particularly on the Internet, Dalrymple & Roderer (1994) 
used "database access systems" in place of IR systems to "acknowledge^] the information sources... that are 
involved and substitute the broad concept of access for the narrower concept of searching" (p. 138). However, 
in this study, IR system includes Internet resource discovery tools, such as search engines and browsers, which 
are used to cover both the identification of resources and browsing of database content (Dalrymple & Roderer, 
1994). Since contents of Internet Web sites are constantly updated, this study covers IR systems dealing with 
dynamic databases, which are "the knowledge potentially available to an information seeker" (Marchionini, 
1993, p- 38). On the other hand, computer-mediated communication of electronic messages between and 
among individuals, such as electronic mail and listservs, is not considered an IR system in this research. 

Thus, for this book, the definition of an information retrieval (IR) system is: 

a system that stores, organizes and provides access to potentially relevant information in 
digital format in static or dynamic databases. 
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The definition of JR interaction is: 

a purposeful “interactive communication processes] that occurfs] during the retrieval of 
information by involving all the major participants in IR, i.e. the user, the intermediary and 
the IR system" (Ingwersen, 1992, p. viii). 

This term represents a view that the searcher (user and/or intermediary) of the IR system is integrated as a 
part of the IR process, in contrast to the traditional system-oriented view in which the searcher is considered 
to be external to the process (Dervin & Nilan, 1986; Hert, 1995). Thus, interaction between users and 
intermediaries, as well as between people and IR systems, is included. An IR interaction begins with an 
initiation of a search request by a user and ends with the user receiving search result from the IR system or 
the intermediary. 

The definition of IR session is: 

the online activity that occurs as a result of a particular query or line of [inquiry] (Nicholas, 

1995, p. 53). 

Thus, for the purpose of this research, IR session is limited to IR interaction between people and IR systems. 
In traditional IR systems, this begins with logging in and ends with logging off (Nicholas, 1995). 

For this book, the definition of information problem solving (IPS) is: 

the active search for and processing of information over a period of time, with specific goals 
or tasks to be accomplished, and not completely taken for granted. 

Other terms such as "information-seeking" (Hert, 1996; Allen, 1996) and "information search" (Kuhlthau, 1992) 
are used to represent the same concept. 

INFORMATION PROBLEM SOLVING AS A PROCESS 

The term IPS was originally coined by Eisenberg and Berkowitz (Eisenberg 8c Berkowitz, 1995) to present a 
model of an information-oriented problem-solving approach to library and information skills instruction called 
the "Big 6." They proposed that IPS is a process consisting of six stages: (1) task definition; (2) information- 
seeking strategies; (3) location and access; (4) use of information, (5) synthesis, and (6) evaluation 1 . 



1 The model is presented in Appendix B1 (1). 






Use of Human Intermediation In Information Problem Solving: A User’s Perspective 



Similar models consisting of slightly different stages are proposed by several other researchers. For example, 
Kuhlthau (1985, 1988a, 1988b, 1988c, 1992) proposes a six-stage model of the "information-seeking process 
(ISP)" based on a series of empirical studies of high-school and college students. Irving (1985) presents a nine- 
stage model of "information skills." Striping and Pitts (1988) propose a 10-step model of a "thinking process" 
for library research. Eisenberg and Brown (1992) found an "overriding similarity" among these process models 
and advocate a "common process approach to library and information skills education" (p. 105). 

Bates (1981) categorizes models of search process into four types: models for idealizing searching (type 1), 
models for representing searching (type 2), models for teaching searching (type 3), and models for facilitating 
searching (type 4). Among the above-mentioned IPS models, Kuhlthau’s model of search process is type 2 
because it was developed and validated empirically mostly in educational settings. Other IPS process models 
were developed from the researchers’ experience but were not empirically tested. In addition, these models 
are largely used for educational purposes, to develop students’ information skills in order to make them self- 
sufficient information problem solvers (type 3 or type 4). Thus, all IPS models found in the literature and 
mentioned above are developed and used within educational settings. 

White (1992) proposes to distinguish IPS activities for "educational purposes" and for "informational purposes." 
According to White, IPS activities for "educational purposes" emphasize learning IPS skills in order to become 
independent information searchers, while those for "informational purposes" emphasize completing the IPS 
task by obtaining appropriate information in time. The user population sought in this study is not limited to 
students. Thus, users may not conduct IPS activities for "educational purposes" of learning IPS skills but rather 
to perform IPS for "informational purposes." As purposes of educational and informational IPS differ, so too 
their processes may differ. Thus, IPS process models in educational settings might not necessarily represent 
IPS processes for informational purposes. 

Moreover, these educational IPS models may be applicable only for the "externally imposed query" but not 
for the "internally developed query." Gross (1995) argues that, in educational environments, students perform 
IPS activities more or less by "externally imposed query" because they are given IPS goals (e.g., assignment 
of writing papers) with a limited range of available topics by their teachers. On the other hand, independent 
searchers with internally developed information needs would conduct IR interaction based on "self-generated 
queries." According to Gross (1995), the IPS process of "externally imposed query" is completed not at the 
time they find information but after searchers communicate what they’ve found to the imposer. Thus, IPS 
models for educational purposes may be limiting in accommodating IPS activities resulted from self-generated 
queries. 

As Bates (1989, p. 410) advocates in her "berrypicking" model, IPS is a process in which each "new piece of 
information [users] encounter gives them new ideas and directions to follow." This research took Bates’s 
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perspective into account to maintain the view that human information-seeking is a process. In short, the term 
IPS is used in this study to represent the process-oriented view of human IPS behavior and try to capture 
human intermediation as its part. At the same time, the study utilized the Big 6 Model of IPS as a guide to 
relate 1R with IPS. The main reason for the selection of the Big 6 Model over other IPS process models was 
that it explicitly presents the information use (step 4) and synthesis (step 5) components that are likely to be 
highly critical in differentiating tasks requested of human intermediaries. Also, the Big 6 Model has been 
acknowledged to be flexible in capturing IPS processes of a variety of people in different settings (Eisenberg 
& Lowe, 1997). Thus, this model seems more useful than others for this research. 

INTEGRATING IR AND IPS RESEARCH 

This research regards IR interaction as a particular activity encompassed in IPS processes. Traditionally, IR 
and IPS research have developed separately. Traditional system-oriented approaches to IR research have 
considered searchers (both users and intermediaries) as external to the IR process, while traditional user studies 
have posited IR systems as sources or channels. Recently, researchers who take user-centered perspectives 
have been trying to incorporate IR interaction as a part of IPS processes by studying direct IR interaction 
between users and IR systems. This research is expected to contribute in the same vein but expand the concept 
of IR interaction by including interaction between the user and the intermediary so as to capture IR interaction 
as involving the user, the intermediary, and the IR system. 

The following section reviews those approaches to examine how far researchers have gone in integrating IR 
and IPS processes. 

Interactive Clarification of Information Problems 

Assuming that a user in an early stage of IPS may not be able to explain the need for visceral information 
need as suggested by Taylor (1968), Oddy (1977) demonstrated the process of users to interact with IR systems 
without initially describing their information needs, but rather to dynamically define them through IR interaction 
in his Thomas IR system. Following the assumption, Belkin and his colleagues (Belkin, 1980; Belkin, Oddy & 
Brooks, 1982a, 1982b) propose to see IR interaction as a communication process in which users are receivers 
of information, and develop an anomalous state of knowledge (ASK) hypothesis. This hypothesis stresses the 
inability of users to describe their information needs accurately and completely. Based on the ASK hypothesis , 
they try to integrate user components into IR system models in order to provide a basis for an IR system design 
which includes dynamically changing users' information needs (Belkin, et al., 1987; Daniels, 1987). In other 
words, they try to develop an IR system model of human intermediaries based on intermediaries' perspectives. 
On the other hand, Hen (1995, 1996) proposes a model that posits IR interaction as a part of higher-level IPS 
process and conceptualizes how users' information needs, translated as user goals, guide the users’ IR 
interaction. 
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The process of defining users’ information needs through JR interaction captured by the above-mentioned 
user-centered IR research may be superimposed over the first three steps of the Big 6 Model They are: (1) 
task definition (i.e., clarification of information need or goal); (2) information-seeking strategies (i.e., selection 
of IR systems, databases, terminology, and/or approaches); and (3) location and access (i.e., interaction with 
the system and/or database). However, none of these models includes the information use and synthesis 
components that are represented as steps 4 and 5, respectively, in the Big 6 Model Similarly, none of the 
existing IR models examined explicitly pointed to the information use and synthesis components of the IR. In 
fact, little empirical research of IR interaction focused on information use or post-search information processing 
behavior (e.g., reading, extracting, and synthesizing of search results) of users or intermediaries. Instead, most 
of the empirical studies of IR user behavior stop data collection at the point when users evaluate search output, 
e.g., by relevance or satisfaction. However, it is not clear whether these researchers consider information use 
as external to the scope of IR research. 

Weak Relevance in Bibliographic IR Interaction 

One of the plausible explanations for the exclusion of the information use component in IR models or IR 
research may be due to the limitation of IR systems of bibliographic databases used in conventional research. 
In order to capture information use behavior, researchers need to examine, first of all, whether or not the user 
actually obtains the original documents. 

This problem is well described by Hert (1995, 1996), who investigates IR interaction of OPAC users by 
combining the multiple qualitative methods of interview, observation (video-recording) and search log analysis. 
She reports that users’ information needs are constant with minimal modification throughout the OPAC 
interaction. Hert (1996) explains this rather unexpected finding as the consequence of Harter’s (1992) "weak 
relevance." That is, OPAC users terminate their IR interaction based on the relevance of surrogates (i.e., 
metadata of books, periodicals, or articles) rather than the actual content of documents. The relevance judgment 
for surrogates is tentative and weak, because the user may not obtain or read the fulltext of documents, or 
s/he may find them irrelevant after s/he has obtained and read them. 

Hert (1996) suggests that even if the user’s goal does not change during OPAC interaction, it may change 
when the user examines the documents themselves. She further proposes that JR interaction with fulltext 
databases may reveal major modification of information needs, as demonstrated by Marchionini (1989). JR 
interaction with fulltext databases may also provide an opportunity to include information use components 
in IR processes by examining how users or intermediaries read fulltext of search results to extract and synthesize 
information, while interacting with the system. 
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Multiple Session Model of IR Interaction 

Saracevic, et al. (1991) propose a multiple session model ofIR interaction based on the analysis of data collected 
from 40 naturally occurring mediated searching processes in an academic library. They found that 45% of 
participants had performed previous mediated searching on the same topic mostly with the same intermediary. 
This finding implies that multiple IR sessions occur in an IPS process. Spink (1997a) further inquires into this 
model by interviewing 200 academic users of OPAC and CD-ROM databases in order to investigate users’ self- 
searching IR sessions over time within an IPS process. She found that a majority of participants (56.5%) had 
conducted more than two IR sessions in an IPS process and that they mostly (79 5%) conducted a first search 
session in an IPS process at the initial stage of their IPS and subsequent sessions at the later stages. 

Based on these findings, Spink proposes the evolving nature of IR interaction in which users conduct multiple 
sessions while developing and modifying their search terms and strategies over subsequent search sessions. 
Based on an analysis of 40 mediated searching processes, Kuhlthau, et al. (1992) propose a way to view the 
multiple IR session model within a framework of her information search process (ISP) in which IPS process 
is seen as a "process [that proceeds] through a series of cognitive stages through which users progressively 
refine and reformulate their information problem" (p. 67). 

Even though these multiple session models do not explicitly suggest so, the different modes of IR interaction 
(i.e., self-searching and use of human intermediation) may occur at different stages of IPS process. For example, 
a user with a visceral or conscious information need (Taylor, 1968) in ASK (Belkin, et al., 1982a, 1982b) may 
conduct self-searching at the initial stage of the IPS process. Through the self-searching as well as interaction 
with other sources, the user’s thought may evolve and the information may need to become more focused so 
that s/he may be able to communicate it with colleagues or professional intermediaries in order to make a 
search request. This seems to be a plausible scenario for academic users who tend to make prior efforts to 
locate information before using human intermediation in mediated mode. However, it may not apply for 
business users who seldom attempt to locate necessary information prior to their use of human intermediation 
(Sandore, 1990). Thus, the multiple session model of IR should be extended to include different modes. The 
reason for different behavioral patterns of academic and business users as implied by Sandore’s findings should 
be investigated as well. 

Post-Search Information Processing 

Relating information use to IR processes is also important to obtain an adequate explanation of why and how 
much post-search information processing may be performed by the user and the intermediary. Assuming that 
IR interaction is a communication process (Katzer, 1987; Wilson, 1981), the intermediaries perform IR 
interactions based on their understanding of users' requests, which presumably reflect the information needs, 
or goals of the users. After the intermediary gets reasonably relevant search output, s/he may perform some 
sort of post-search information processing (e.g., read, evaluate, and synthesize the search result) to make it 
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readily usable for the user’s goal. If the user is an important client for the intermediary and the intermediary 
has confidence in her/his own understanding of the users' information need, then it is quite reasonable to 
assume that the intermediary would put much effort into post-search information processing so as to present 
an optimal search outcome readily applicable for the user. 

However, only a few empirical studies of IR user behavior reviewed focus on the post-search information 
processing of intermediaries (Wilson, 1999). On the other hand, some anecdotal evidence suggests that librarians 
perform post-search information processing in business and industrial environments. According to Bell (1990), 
in industry, "on numerous occasions department directors were asked by their supervisors, usually vice 
presidents, to complete comprehensive reports on a particular topic in a very short period of time" (p. 53). 
Comparing his experience as an online searcher in an academic and a corporate environment, Carey (1985) 
reported that "I edit search results for inclusion in memos and proposals. The job is not just finding information 
online, but making it attractive as a product so that the patron can use it in various ways" (p. 56). 

By contrast, based on a series of interviews of users in corporate libraries, O’Day & Jeffries (1993a) report that 
almost all the regular clients of online search services in corporate libraries he studied perform this post-editing 
function to develop artifacts in order to communicate the search results to their colleagues and ultimate users. 
The format of the artifacts developed by these clients includes annotated excerpts, summaries, reports, 
spreadsheets, charts, graphs, slides, visuals, etc. O’Day and Jeffries call these clients "information artisans" and 
categorize the pattern of information sharing into four types: (1) updating team members, (2) broadcasting, 
(3) consultant, and (4) archiving. According to him, the degree of post-processing differs depending upon the 
type of sharing - ad hoc broadcasting and archiving require minimal processing, while consulting and team 
sharing involve the development of higher-level information products with complex analysis. Even though 
ODay and Jeffries (1993b) found that post-search information-processing tasks are mostly done by library 
clients rather than librarians, they report on two cases of business consulting firms in which librarians who 
acquire domain expertise performed some or all of the first-hand analysis to produce synthesized search 
reports. 

Based on O’Day and Jeffries’s (1993a, 1993b) findings as well as some anecdotal evidence presented above, 
this research assumes that some degree of post-processing is performed either by users or by intermediaries. 
This is because the intermediaries need to communicate search results to users and users may need to share 
the search outcome with other people. 

HUMAN INTERMEDIATION IN IR AND IPS 

This study focuses on a particular search tactic 2 employed by a person in accessing and using a variety of IR 
systems, namely, the use of human intermediation. 

2 Here, the term "search tactic" is used to mean "a move made to further a search corresponding to the situation 0 (Bates, 1979a, 1979b). 
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User vs. Intermediary 

Most of the existing studies distinguish between users and intermediaries based on their formal functions rather 
than the role performed by searchers. This research will follow such distinctions, but the role of users is further 
distinguished situationally based on the context of the IPS process. 

Instead of "users," the term "end-users" is often used in the literature to represent searchers who performs IR 
interaction by themselves based on their own information needs (Buntrock & Valicenti, 1985). However, "end- 
user" was originally coined to mean a person for whom the librarian did searches (Ojara, 1986). Trying to 
resolve this confusion, Janke (1985) uses "client searcher" to mean "anyone who, as a patron of an institutional 
online service, chooses to run his own search," in contrast to "lay searcher" which he defines as "anyone who 
conducts his or her own online searches, regardless of environment" (p. 13). Any of these terms, however, 

seems to represent the view of professional intermediaries who categorize searchers into information 

✓ 

professionals and non-information professionals. They collectively label the non- information professional 
searchers as "end-users" or "client searchers" without taking into account the fact that some non-professional 
searchers may act as intermediaries and perform the IR-interaction for other users. On the other hand, Bawden 
(1990) refers to users as information professionals in his user-oriented evaluation. 

In this research, users are defined as clients of human intermediaries. Thus, for the purpose of this research, 
a user is defined as: 

a person who uses human intermediaries in her/his IR and/or IPS processes. 

However, the definition does not necessarily imply that users always use human intermediation to use IR 
systems. They may perform self-searching by directly manipulating IR systems. The user may be an originator 
who generates an information need, a collaborator who takes part in IPS project involving multiple people, 
or a proxy who represents other people's information needs. 

Before IR systems became directly accessible to users, most of the IR sessions involved trained information 
professionals such as librarians and professional searchers (Hawkins, 1981; Eisenberg, 1983). However, the 
literature often reports cases in which people other than professional intermediaries perform the IR interaction 
on behalf of users (Mischo & Lee, 1987; Ojara, 1986; White, 1992; Nicholas, et al., 1986; Nicholas, 1996). 

On the other hand, researchers in information science have investigated people who act as mediators for other 
people to facilitate their IPS. For example, the emergence of "technological gatekeepers," as coined by Allen 
(1977), has frequently been reported as a result of IR user training in industrial environments (Richardson, 
1981; Cole & Bawden, 1996). In fact, Metoyer-Duran (1993) examines the role of gatekeepers in ethnolinguistic 
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communities and predicts the emergence of electronic gatekeepers 3 who act as filters of electronic information 
to a group of users. 

Some researchers try to define the new role of professional information intermediaries in a way that expands 
the traditional function of librarians. For example, Dosa (1985) introduces the concept of the "information 
counselor" who is engaged in locating, obtaining, evaluating, synthesizing and interpreting information 
resources, as well as in giving advice to users' on their information problems. 

Recently, the term intermediary is sometimes used to mean "software that performs search assistance functions 
that have traditionally been performed by human intermediaries" (Dalrymple 1994, p. 139). This study, however, 
assumes the intermediary to be a human. 

For the purpose of this study, the definition of the term intermediary is: 

a person who performs IR sessions on behalf of a user. This person may be a trained 
information professional such as a librarian or information specialist, but can be anyone. 

Self-Searching vs. Human Intermediation 

In an environment where direct access to both IR systems and human intermediaries is readily available, a 
user who wants to obtain information from an IR system has a choice of finding information by directly 
manipulating IR systems or making a request of a human intermediary. 

The first choice is self-searching in which users interact with the IR system directly by manipulating the system 
with or without the help of the intermediary (Hurt, 1983)- This alternative is also called direct mode 
(Deschatelets, 1982). In self-searching , users interact directly with IR systems during the IR session. 

As stated above, the definition of a self-searching for the purpose of this research is: 

an IR interaction in which users interact with IR systems directly and conduct the entire IR 
session by themselves. 



3 She said, "as the National Research and Educational Network (NREN) emerges and extends throughout the educational system, human gatekeepers and the population 
they serve may draw on gateways and the so-called electronic gatekeepers that serve as information filters to a community of users" (p. 1 1 1). 
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The other choice is to make a request of a human intermediary to manipulate IR systems on behalf of users. 
This choice is called human intermediation in this research and is defined as: 

a search tactic or action employed by a user in which a user relies on a human intermediary 
in performing an IR and/or IPS task on behalf of the user. 

Since this research considers IPS as a process that may include IR interaction , both self-searching and the use 
of human intermediation are also seen as activities encompassed within a user's IPS process. 

Level of Interactivity in Human Intermediation 

The term interactivity is defined as: 

the propensity to act in unison with external objects or other people (Marchionini, 1995). 

IR interaction and human intermediation imply interactivity. In self-searching, interaction occurs between the 
user and the IR system. In human intermediation, interaction is assumed both between the user and the 
intermediary and between the intermediary and the IR system. In fact, the IPS process itself is an interactive 
process that "depends on initiatives on the part of the user, feedback from" the IR system (in self-searching) 
and from the intermediary (in mediated searching), "and decisions for subsequent initiatives based on this 
feedback" (Marchionini, 1995, p- 17). 

Different levels of interactivity between the user and the intermediary are assumed for human intermediation. 
In other words, the human intermediation may be initiated either by a face-to-face or telephone interview or 
by written communication from the user to the intermediary as a one-shot request to which the intermediary 
responds with the answer. 

FINDINGS ON HUMAN INTERMEDIATION IN IR AND IPS RESEARCH 

A great deal of the literature in library and information science (LIS) reports findings on human intermediation. 
This section begins with the historical development of IR systems and services to provide a general trend of 
IR interaction shepherded from the dominance of human intermediation toward self-searching by users. The 
rest of the section focuses on the characteristics of IR sessions performed by human intermediaries in 
comparison to those of users' self-searching, tasks performed by intermediaries in human intermediation, as 
well as the characteristics and situations of users who use human intermediation in comparison to those of 
self-searchers. 
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OVERVIEW OF HISTORICAL DEVELOPMENT 
OF IR SYSTEMS AND SERVICES 

The advance of IR systems with their impact on users’ IPS behavior in libraries has been extensively reviewed 
by Hawkins (1981), Mischo and Lee (1987), Nicholas and Harman (1985), Dalrymple and Roderer (1994), and 
Nicholas (1995). 

Historical Background 

The concentration of existing studies on the comparisons of search processes performed by users with those 
by intermediaries upon requests of users seems to reflect the historical development of IR systems and services 
in various types of libraries and information services. The introduction of commercial online bibliographic IR 
systems in the early 1970s was originally intended to provide enhanced access for users. But librarians and 
professional intermediaries were the major users of these systems they performed searches on behalf of users 
for the following reasons: 

• variability of command and search interfaces among different vendors, 

• rapid increase in the number of databases available through different vendors, 

• complexities of search-strategy formulation and search logic, 

• lack of standardization in database structure, and 

• substantive costs of online searching and printing (Eisenberg, 1983; Hawkins, 1981; Mischo & Lee, 
1987). 

Since the 1970s, increased availability of and enhanced accessibility to a variety of IR systems, including online 
public access catalogs (OPACs), locally mounted bibliographic databases, as well as stand-alone and networked 
CD-ROMs, have provided users with multiple means of accessing and using electronically stored information 
without direct charge. In addition, an increased variety of numeric, fulltext and visual databases have provided 
users with enhanced opportunities for directly interacting with IR systems. Training activities aimed at 
encouraging self-searching of IR systems among users of commercial bibliographic databases were expanded 
in the 1980s with the increased availability of more or less user-friendly search systems (Mischo & Lee, 1987). 

User searching behavior with respect to consumer online services such as CompuServe and America Online 
has not been thoroughly studied. In spite of their popularity among users, the literature merely reports 
demographic characteristics of typical users as highly educated professional or executive white males (Nicholas, 
1995). 

Recent widespread use of the Internet with a variety of search engines and browsers has provided users with 
another alternative IR system. A great deal of information on a local, national and global scale is accessible 
through this alternative. Access to the Internet has been expanded from academic to public and industrial 
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environments. Consequently, free or inexpensive textual and factual data in a variety of domains have become 
available to users. Increased access to a variety of IR systems through multiple alternatives has provided users 
with a more or less information rich environment in which they have access to some or all of the above- 
mentioned IR systems through self-searching and/or human intermediation. 

Internet- Based Digital Reference Services (DRSs) 

Digital reference services (DRSs) are online question-answering services that attempt to fulfill the information 
needs of their clients. They are also known as "AskA services” (Lankes, 1998; Wasik, 1998). The intermediation 
between clients’ requests and information provision can be performed either through human intermediaries 
or through automatic interface (Lankes, 1988). Typically, these services respond to online inquiries of clients 
by directing them to relevant electronic or print resources and/or providing factual information. If the clients’ 
requests are ambiguous, an online reference interview may be generated by human intermediaries to help 
define clients’ information needs (Lankes, 1998, Wasik, 1998; Ryan, 1996). 

With the expansion of the Internet, DRSs become available on the Internet and are getting increasingly popular 
as people realize the disorganized nature of Internet resources and limitations of search engines (Janes, 1996). 
The number of requests received by some of the Internet-based DRSs is growing exponentially (Lankes, 1995, 
1998). These services are offered either free of charge or are fee-based. They are not necessarily affiliated to 
libraries - some of them are affiliated to libraries and intermediation is performed by librarians, while others 
are affiliated to a variety of organizations and staffed by domain experts and/or librarians including volunteers 
(Ryan, 1996; Wasik, 1998). Most of these services are open to the general public Internet community, but some 
of them restrict their client base in order to limit the number of requests received (Wasik, 1998). 

Clients of Internet-based DRSs have access to both self-searching of Internet web sites using search engines 
and human intermediation provided by these services. Thus, these clients have the choice between self- 
searching and human intermediation if they want to search for information on the Internet. Therefore, it is 
interesting to examine why and in what situations they use DRSs. Published research on Internet-based DRSs 
is, however, concentrated on activities and management concerns of service providers (Ryan, 1996; Lankes, 
1998; White, 1999). As a result, the behavior of their clients is not well studied. Except for occasional user 
surveys conducted by service providers, the literature provides little information about their users. 

Research Trends in IR Behavior 

As described above, the general trend of IR activities has shifted from human intermediation toward self- 
searching by users. However, this trend does not necessarily mean that all users have adapted to self-searching. 
Instead, numerous studies report on the emergence of electronic gatekeepers among users (Richardson, 1981; 
Bodtke-Roberts, 1983; Arnold, 1987; Seefeldt & Thomas, 1986; Nicholas, et al., 1986; Cole & Bawden, 1996). 
These electronic gatekeepers perform searches of IR systems on behalf of other users. In addition, human- 
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mediated DR Ss in the Internet environment have become increasingly popular. Some of the users who have 
direct access to more or less user-friendly IR systems, such as the Internet search engines, are still relying on 
human intermediation offered by Internet-based DRSs. 

Existing studies concerning human intermediation generally aim to address the following: 

• The characteristics of the search process performed by users compared to that performed by 
information professionals, 

• Tasks performed by intermediaries in human intermediation, and 

• The characteristics of users who perform self-searching and those who use human intermediation. 



Following sections review findings of existing studies of users' self-searching and human intermediation as 
seen from information professionals' view. 

SEARCH PROCESS OF USERS AND INFORMATION PROFESSIONALS 

A great deal of US literature reports on search processes of either self-searching done by users or mediated 
searching performed by professional intermediaries or both. Table 2-1 compares and contrasts empirical findings 
of IR interaction performed by users with that by professional intermediaries for several dimensions. Each 
dimension is discussed further with relevant findings in the following section. 

General Characteristics of Search Process 

US literature reports several characteristics of users' search process as distinct from those of information 
professionals. This section summarizes these characteristics of search process variables. 

Preparation 

Based on professional intermediaries' standards, users do not make sufficient preparation before starting online 
sessions. Users use limited sources for term selection. By contrast, professional intermediaries generally make 
more efforts in preparation and use more thesauri and dictionaries for term selection. However, Hsieh-Yee 
(1993) reports that even professional intermediaries put less effort in preparation before searching a familiar 
topic (library science) than an unfamiliar topic. Thus, the amount of time and effort spent in preparation may 
not reflect the higher quality of the search conducted by professional intermediaries but simply the results of 
a lack of domain knowledge held by the professional intermediaries. Hence users are believed to have better 
domain knowledge of the topic of the search than professional intermediaries (Saracevic, et al., 1988; O'Day 
& Jeffries, 1993a, 1993b; Spink, 1997b). Thus, it is natural for them not to expend much effort in preparation 
for the search. 
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Table 2-1: Findings of Search Process 



Process 

Dimension 


Self-Searching by Users 


Searching by Intermediaries 


Preparation 


Do not have sufficient preparation (Janke, 1 984) 

Use limited sources for term selection (Salovaara, 
1988; Hsieh-Yee, 1993) 


Make efforts in preparation (Hsieh-Yee, 1993) 

Use more thesauri and dictionaries fa term selection 
(Salovaara, 1988; Hsieh-Yee, 1993) 


Strategy 


Simple and straightforward (King, 1991) 

Fail to use alternative approaches (Kirby & Miller, 
1986; McKibbon, et al., 1990) 


Great variability among searchers (Fenichel, 1981; 
Fidel, 1981; Harter, 1984; Saracevic, et al., 1988; 
McKibbon, et al., 1 990; Hsieh-Yee, 1993) 


Search Terms 


Don’t distinguish between natural language and 
controlled vocabulary (Hsieh-Yee, 1 993) 

Use natural-language (Walton & Dedert, 1983; 
McKibbon, et al., 1 990; Hsu, 1991) 

Don't use controlled vocabulary (Walton & Dedert, 
1 983; Kirby & Miller, 1 986; McKibbon, et al., 1 990) 


Use more controlled vocabulary (Fenichel, 1981; 
Harter, 1 984; Lancaster, et al., 1 994) 

Use more synonyms and try more term combinations 
(Hsieh-Yee, 1993) 

Overlap in selection of terms is quite low (Saracevic 
etal., 1988) 


Command 


Use less-advanced search commands (Fenichel, 
1981; McKibbon, etal., 1990) 


Use more variety of commands (Fenichel, 1981) 


Interactivity 


More interactive (Fenichel, 1 981 ; Marchionini, 1 995; 
Marchionini, 1989; Shenouda, 1 990) 

Browse online (Fenichel, 1981; Haines, 1982; 
Marchionini, 1995; Nicholas, 1995) 

Pay more attention to the interim results (Marchionini, 
1995) 

Use feedback to reformulate searches (Marchionini, 
1989) 

Fail to take advantage of feedback (Jacobson & 
Ullman, 1989) 


Less interactive (Fenichel, 1981; Lancaster, et al., 
1994) 

Perform fast-batch online search (Fenichel, 1981; 
Harter, 1984) 

Browse online less frequently (Harter, 1984) 

Do not pay much attention to interim results to take 
advantage of feedback (Saracevic, et al., 1988) 

Rely on indexing terms or journal title and date in 
examining and reformulating searches (Hsieh-Yee, 
1993) 


Errors 


Make more non-typographic errors (Fenichel, 1 981 ; 
McKibbon, et al., 1990; King, 1993) 


Make same level of typographic errors as users 
(Fenichel, 1981) 


Databases Used 


Use single or a few databases (Salovaara, 1 988; Ikeda 
& Schwartz, 1 992; Hart & Rice, 1 991 ; Dalrymple & 
Roderer, 1994) 

Use fulltext databases (Hart & Rice, 1991) 


Use more databases (Salovaara, 1988) 

Use bibliographic databases (Hart & Rice, 1991) 


Output 


Satisfied with abstracts and no need to obtain fulltext 
(Salovaara, 1988; Haynes, et al., 1990) 


Overlap in retrieved items is quite low (Saracevic et 
al., 1988; McKibbon, et al., 1 990) 
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Search Strategy 

Search strategies employed by users are simple and straightforward. They fail to use alternative approaches 
when the initial approach does not provide satisfactory results. In contrast, professional intermediaries use 
more sophisticated search strategies and try different approaches when the initial strategy fails. However, a 
majority of the literature reports a great variability observed among approaches employed by professional 
intermediaries even for the same request (Saracevic et al., 1988; McKibbon, et al. 1990; Lancaster et al., 1994). 
In short, even though professional intermediaries seem to use more sophisticated strategies compared to users, 
the variability among professional intermediaries is so great that systematic differences between professional 
intermediaries and users seem trivial. 

Search Terms 

Reflecting the lack of preparation, users do not use a controlled vocabulary but use natural language. They 
don’t distinguish between natural language and controlled vocabulary. However, there is one exception. Based 
on a questionnaire survey of faculty members in an academic medical environment, Hsu (1991) found that 
65% of respondents use MeSH 4 quite often. However, this finding may be due to the difference in perception 
for the meaning of "often" held by users and professional intermediaries 5 . In contrast, information professionals 
generally use more controlled vocabulary and more synonyms, and try more term combinations. However, 
different information professionals use different terms for the same request - overlap in selection of terms 
among information professionals are quite low even for the same request (Saracevic, et al., 1988). Moreover, 
professional intermediaries use their own terms rather than controlled vocabulary for searching a familiar topic 
(library science) while using more synonyms and controlled vocabulary for an unfamiliar topic (Hsieh-Yee, 
1993). Thus, the use of controlled vocabulary and synonyms may not necessarily reflect the difference between 
users and professional intermediaries but the difference in their domain knowledge of the search topic. 

Search Command 

Users use fewer and less-advanced commands compared to professional intermediaries. This may reflect users’ 
lack of experience with a particular 1R system, but experience with an IR system does not increase users’ use 
of advanced system features (King, 1991; Nicholas, 1993). 

Interactivity 

Users are more interactive than professional intermediaries. They use feedback to reformulate their searches 
rather than planning search strategies in advance. Thus, they browse extensively while online and pay more 
attention than professional intermediaries to the interim results, particularly in searching fulltext databases. 



4 Medical Subject Heading, the controlled vocabulary used in MEDLINE and other databases developed by the National Library of Medicine (NLM). 

5 Fidel (1991) found that 64% of search terms used by professional intermediaries in medicine were controlled vocabulary. This ratio far exceeds the average share of 
controlled vocabulary in science and technology, social sciences, humanities and general. 
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Users use feedback to reformulate searches. However, some users fail to take advantage of feedback, due to 
the lack of knowledge on how to use system functionality. 

On the other hand, professional intermediaries perform least-interactive online search - they do not use the 
interactive capability of online systems (Fenichel, 1981). They browse online less frequently and do not pay 
much attention to interim results to get the advantage of feedback. When they do, they rely on indexing terms, 
journal title and date of publication in examining and reformulating searches for unfamiliar topics even when 
abstracts are available (Hsieh-Yee, 1993). 

Errors 

Users make more non-typographic errors such as errors in the use of Boolean operators and inappropriate 
use of controlled vocabularies. However, information professionals make the same level of typographic errors 
as users. A large share of non-typographic errors made by users may reflect the lack of understanding of the 
system features and search logic by users as suggested by Borgman (1996). 

Database Used 

Users use single, or a smaller number of, databases compared to professional intermediaries. Self-searching 
of bibliographic systems in academic environments is characterized as use of a single database, but multiple 
databases are frequently used in some non-academic environments (Vollaro & Hawkins, 1986; Nicholas, 1995). 
Type of database used may differ. Users tend to search fulltext and numeric databases directly while making 
use of human intermediation for bibliographic databases of professional intermediaries (Hart & Rice, 1991). 

Search Output 

Two studies in non-academic environments report that users are generally satisfied with abstracts and do not 
request fulltext as the results of self-searching of bibliographic databases (Salovaara, 1988; Haynes, et al., 1990). 
They attribute this finding to the exploratory nature of self-searching. Reflecting the difference in search terms 
used by different professional intermediaries for the same search request, overlap of retrieved items for the 
same request among different information professionals is found to.be quite low. However, Saracevic, et al. 
(1988) suggest that items retrieved by more than two professional intermediaries for the same request have 
higher chances of being relevant. 

Sources of Variability Among Professional Intermediaries 

As described above, empirical research to date on human intermediation reveals a great variability among the 
search processes and search results even for the same request. A few researchers are inquiring into the source 
of variability among information professionals in selection of terms and approaches. So far, individual differences 
of search style of searchers and difference in the level of domain knowledge among searchers have been 
empirically investigated as sources of such variability. 
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Individual Differences 

Fidel (1991) explored search processes performed by 47 professional intermediaries (i.e., online searchers) in 
human intermediation using verbal and protocol analysis with observation. Based on the analysis, she proposed 
that the use of controlled vocabulary differed depending upon domain of the topic of search, type of question 
as well as type and number of databases used. She reported that science searchers (except for the medical 
domain) used more textwords 6 than searches in other subject areas, that searchers who deal with practical 
questions tended to use more textwords than those who addressed theoretical questions, and that searchers 
using multiple databases tended to use textwords more often than those who used a single database (Fidel, 
1991). She also found that searchers consulted thesauri only when they used databases accompanied by high 
quality thesauri. Based on these findings, she concluded that selection of search keys was situational. She 
suggested that there were two types of professional searchers: operationalists and conceptualists (Fidel, 1981; 
Fidel, 1991)- Opera tionalist searchers tended to employ operational r, move[s] that use[s] the system features in 
order to modify a retrieved set [to improve precision] without changing the conceptual meaning it represent.” 
On the other hand, conceptualist searchers used conceptual moves that "modifly] a retrieved set by modifying 
the meaning of the concept it represents” (Fidel, 1981, p. 68) to improve both recall and precision. She further 
argued that operation a list searchers tended to put less effort in preparation, use textwords obtained from users 
and avoid controlled vocabulary, they used more search commands to improve the search interactively. She 
also claimed that operationalist searchers put less emphasis on recall than conceptualists. Based on the above, 
Fidel concluded that operationalists tended to be more interactive than conceptualists. She further proposed 
that interactivity is an inherent characteristic of the searcher rather than developed through experience or 
training. She also argued that domain knowledge is required to change the concept, and therefore, 
conceptualists may have better domain knowledge than operationalists (Fidel, 1991). 

Domain Knowledge of the Topic of Search 

Hsieh-Yee (1993) inquires into the effect of domain knowledge and search experience on IR interaction by 
comparing search tactics used by novice users and experienced information professionals 7 , using the same 
two artificially developed questions - one corresponds to the domain of users, the other is in library science. 
She found professional intermediaries tend to use more controlled vocabulary, spend more effort in preparing 
the search, monitor the search more closely, and include more synonyms and more terms for searches in 
unfamiliar areas. But they use their own terms and spend less effort in preparation when searching regarding 
the issue of library science. On the other hand, the use of search tactics by novice users does not reveal any 
significant difference between familiar and unfamiliar topics. Based on these findings, she concludes that 
subject knowledge affects only experienced searchers. But I think this conclusion may be limited, because 



6 Fidel (1991) categorized search keys used by intermediaries she studied into textword and thesaurus word. Textwords are words are non-descriptors or search keys 
not included in a thesaurus. 

7 Because she defined experienced searchers as "professional searchers who have at least one year of search experience. . she compared professional intermediaries 
with end-users rather than experienced searchers with non-experienced searchers. 
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she did not include experienced searchers who are experts in the area other than library science as participants 
in her study. Hence it may be the case that different tactics used by professional intermediaries in searching 
an unfamiliar area in her study may reflect their professional training focused on searching in unfamiliar 
domains rather than pure search experience. As reported by King (1991) and Nicholas (1995), experienced 
users do not use a wider scope of system features compared to inexperienced ones. Thus, search processes 
of experienced searchers who do not have professional training in library and information science may be 
different from those of professional intermediaries. In order to confirm domain knowledge and search 
experience to be significant factors in improving JR interaction , the use of tactics by non- professional domain 
experts who have extensive search experience, such as electronic gatekeepers, should also be compared with 
tactics used by novice users. 

On the other hand, based on an analysis of naturalistically occurring human intermediation, Spink (1993) 
proposes that domain knowledge held by users associates with higher precision of the search results only 
when they have some experience of human intermediation within the same IPS process. These findings imply 
that a combination of domain knowledge and search experience within a specific IPS process may lead to a 
successful JR interaction. 

Conclusion on Search Process Variables 

Findings on the search processes of users and professional intermediaries of bibliographic databases imply 
that users perform their self-searching in a rather simple and straightforward manner compared to exhaustive 
approaches taken by professional intermediaries. However, the higher interactivity that characterizes users’ 
search process, particularly for fulltext databases, seems to imply different approaches taken by users and 
professional intermediaries. 

Though the literature suggests some differences between search processes and tactics employed by users and 
professional intermediaries, these findings do not necessarily reflect the systematic superiority of either users 
or professional intermediaries. Rather, the source of difference seems to be knowledge, experience, training 
and individual differences of searchers. Thus, these search process variables seem not very useful in explaining 
users’ preferences of a particular mode of IR interaction. However, since professional intermediaries perform 
rather exhaustive searches with multiple approaches for unfamiliar topics, users may make requests of 
professional intermediaries when they need a comprehensive search and/or search particularly in a domain 
external to their expertise. 

On the other hand, variability in approaches found among users and information professionals is quite 
impressive. The literature implies that sources of such variability may include individual differences and 
situational variables such as searchers’ knowledge and skills. 
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TASKS OF PROFESSIONAL INTERMEDIARIES IN IR INTERACTION 

Even though numerous studies have examined the process of user self-searching and searching performed by 
professional intermediaries for users, little has been known empirically about what kinds of functions are 
actually performed by professional intermediaries as seen by users. Lack of empirical research based on a user 
perspective is at least partially due to the fact that LIS research has been focusing on the characteristics of 
intermediaries in human intermediation to discover "the qualities of the good professional intermediary" in 
order to use them as the model for designing expert systems (Spink, 1997b, p. 275). 

Tasks Requested of Intermediaries by Self-Searchers 

A great deal of US literature insists on the importance of user training in IR interaction Qanke, 1984; 
Mischo & Lee, 1987; Cole & Bawden, 1996). In fact, many authors suggest the shift of the role of 
librarians from intermediation to user training and intervention in user self-searching (Dalymple & 
Rodderer, 1994). In spite of the high enthusiasm and wide acceptance of self-searching in academic 
environments in the 1980s, many researchers reported that users often require the extensive 
assistance of librarians even after attending training sessions. Typical kinds of help requested by 
users in self-searching of bibliographic databases reported are: 

• Search strategy formulation (Kirby & Miller, 1986; Penhale & Emard, 1986; Poisson, 1986; Friend, 
1985), 

• Use of Boolean logic (Poisson, 1986; Borgman, 1986; Friend, 1985; Leipzi, et al., 1983; Mader & 
Park, 1985; Slingluff, et al., 1985; Trzebiatowski, 1984; Janke, 1984), 

• Use of search commands (Sewell & Teitelbaum, 1986), 

• Selection, combination and modification of search terms (Mischo & Lee, 1987), and 

• Technical problems such as computer use particularly in network connection and printing (Janke, 
1984; Friend, 1985; Mischo & Lee, 1987). 



On the other hand, infrequent users of online bibliographic databases in non-academic environments are 
found to have difficulty in using controlled vocabulary (Walton & Dedert, 1983), remembering special features 
of each database and finding appropriate search terms (Vollaro & Hawkins, 1986). 

Even though full text, numeric, and visual databases are increasingly available for self-searching, little is reported 
in the literature on user training and characteristics of help required in searching these databases. However, 
it is not clear whether it is because professional intermediaries are not involved in self-searching of these 
databases as suggested by Dalrymple & Roderer (1994). 



48 



43 





Chapter 2: What Do We Know About User Behavior in Human Intermediation 












# 



Tasks Performed by Professional Intermediaries in Human 
Intermediation 

Textbooks of online searching aimed at librarians and professional intermediaries usually include extensive 
lists of tasks in sequence that are recorrimended to be followed to perform successful IR interaction in human 
intermediation (Walker & Janes, 1993; Lee, 1989)- Some authors present these activities in the form of flow- 
charts. However, these lists or flowcharts tend to be rather prescriptive, idealizing the search process for 
teaching or facilitating searches. Therefore, they may not adequately describe what is actually performed by 
professional intermediaries (Bates, 1981). An exception is the following list presented by Fidel & Soegel (1983, 
p. 169) as a part of an exhaustive taxonomy of factors affecting online bibliographic retrieval based on a review 
of empirical literature. 

1 Query formulation 

2 Selection of search system(s) and database(s) 

3 Interaction with the search system(s) and database(s) 

4 Termination of the search and final set 

3 Post-logoff activities 



There are three possible limitations to the above list of tasks performed by users and/or intermediaries as a 
basis for a user perspective taken in the context of this study. First, the above list represents tasks in bibliographic 
IR interaction. By contrast, this study covers not only IR systems with bibliographic databases but also with 
fulltext, numeric and graphic ones. Second, the above list is based on empirical studies of human intermediation 
by professional intermediaries. But this study focuses not on tasks actually performed by intermediaries but 
rather those requested by users of human intermediaries. Third, the above list may reflect professional 
intermediaries' perspectives rather than users', because empirical studies that have been examined in developing 
the list are search processes of librarians. Thus, the process is seen entirely from intermediaries’ viewpoints. 
By contrast, this study attempted to see human intermediation from users' viewpoint. Hence the same process 
of IR interaction in human intermediation may induce different connotations and meanings for users and 
intermediaries. Within that limitation, empirical research on human intermediation informs the following 
characteristics of tasks performed by intermediaries. 

Clarification and Diagnosis of Users' Information Needs 

In the LIS literature, professional intermediaries are generally assumed to be trained individuals who search 
online databases quickly and efficiently. They have extensive knowledge and experience to conduct interviews 
in order to elicit information needed by users and to focus the scope of the search (Dalrymple & Roderer, 
1994), but do not have good domain knowledge of the topic of the search (Saracevic, et al., 1988; O'Day & 
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Jeffries, 1993b; Spink, 1997b). Thus the role of professional intermediaries is to use their knowledge and 
competence of the IR system "to provide clarifying and diagnostic aspects" (Spink & Saracevic, 1997, p. 745). 

Selection of Controlled Vocabulary and Tactics 

Based on a series of analyses of 40 naturalistically occurring mediated DIALOG search processes in an academic 
library, Spink (1997b) identifies five kinds of mutually exclusive interactive feedback components that make 
up the IR process. They are: (1) content relevance feedback (CRF); (2) term relevance feedback (TRF); (3) 
magnitude feedback (MF); (4) tactical review feedback (TCF), and (5) terminological review feedback (TMF). 
Spink found that content relevance feedback (CRF) in which the IR system output is reviewed to reformulate 
the query was primarily initiated by users. On the other hand, term relevance feedback (TRF) in which new 
search terms are selected based on IR system output, as well as magnitude feedback (MF) in which size of 
the IR system output is modified, were mostly initiated by intermediaries. Tactic review feedback (TCF) in 
which display of previous search strategy is used to generate the subsequent query, and terminological review 
feedback (TMR) in which display of index terms is used to generate the subsequent query, were always initiated 
by intermediaries. 

Using the same data, Spink & Saracevic (1997) classified sources of terms used in retrieval into five mutually 
exclusive categories in order to identify the source of the terms that retrieved items judged relevant by users. 
They are-, question statement (QS); user interaction (UI); thesaurus (TH); intermediary (IN); and term relevance 
feedback (TRF). Through the analysis they found that two classes of user generated terms, question statement 
(QS) and user interaction (UI), shared the majority (61%) of total of 593 terms. These results imply that 
information professionals perform tasks of selecting a controlled vocabulary and narrowing down search results 
to a manageable size. 

Lack of Research on Post-logoff Activities 

No empirical literature examined for this review focuses on post-logoff activities performed by information 
professionals. On the other hand, O’Day and Jeffries (1993b) found that regular clients of online search services 
in corporate libraries perform extensive post-processing of search results in order to share information with 
others. Thus, these users might act as Intermediaries for other people. 

Lack of empirical research on post-search information processing done by information processionals may be 
due to the fact that most of the studies of human intermediation in naturally occurring IPS involves academic 
librarians as intermediaries. Because academic librarians are generalists rather than domain experts in terms 
of the topic of search, they may be reluctant to make relevance judgments or to perform extensive analysis 
and/or editing of search results. Different from academic librarians, professional intermediaries in special 
libraries, as well as electronic gatekeepers emerged among users as the results of user training, may have 
better domain knowledge on the topic of the search. They may have better understanding of users’ information 
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needs reflecting close proximity of their working relationship with users. Thus, users may expea these non- 
professional intermediaries to perform a wider scope of post-search information processing tasks, including 
reading, evaluating and synthesizing search results as a part of post-logoff activities, particularly for fulltext 
and numeric databases. 

Conclusion on Tasks Performed by Intermediaries in IR Interaction 

This section identified the major types of tasks requested of librarians by users in performing self-searching 
based on observations made by professional intermediaries, and found the major contributions of users in 
mediated searching to be the selection of terms and relevance judgment. Also, it presented a list of tasks 
performed by professional intermediaries in mediated searching developed through a review of empirical 
research. 

On the other hand, major contributions of professional intermediaries are identified as initial development and 
subsequent modification of search strategy as well as controlling of the magnitude of output within a 
manageable size. However, tasks in post-logoff activities as being performed by information professionals are 
not reported probably because empirical research is lacking on this aspect. 

CHARACTERISTICS OF SELF-SEARCHERS 
AND THOSE WHO USE HUMAN INTERMEDIATION 

The introduaion of user training programs for online bibliographic IR systems in the 1980s resulted in a high 
level of interest in and acceptance of self-searching in academic environments, particularly among students 
(Mischo & Lee, 1987). On the other hand, user training in non-academic environments leads to rather 
disappointing results with more than a 50% dropout rate (Richardson, 1981; Haines, 1982; Walton & Dedert, 
1983; Nicholas, et al., 1986; Harman, 1986). It seems as if there is a difference in acceptance by users of self- 
searching between academic and non-academic environments. 

Table 2-2 shows charaaeristics of users who perform self-searching and those who use human intermediation 
based on the literature. These characteristics include both situational faaors and individual differences and 
are categorized into several dimensions. Reflecting the difference observed between academic and non- 
academic environments, charaaeristics peculiar to users in academic environments are shown with one asterisk 
(•) while characteristics of users in non-academic environments are shown with two asterisks (**)• Each 
dimension of the user characteristics is discussed further in the following section. 
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Table 2-2: Characteristics of Self-Searchers and Those Who Use Human Intermediation (1/2) 



Dimensions 



1. Motivation 



2. Economic 
considerations 



3. Knowledge 
and skills 



4. Role and 
status of users 



Experience of 
using human 
intermediation 



Nature of 

information 

need/use 



7. Type of 
database used 



8. Accessibility 



9. Individual 
difference 



10. Other 
situationality 



Self-Searchers 



Enthusiastic about self-searching (Case, et al., 1986; Kirk, 1986; 
Bell & Halperin, 1989; Dalrymple, 1990) 

Satisfied with self-searching (Barber, et al., 1973; Hsu, 1991) 

Perceive seff-sufficient (Hart & Rice, 1 991 ; Ikeda & Schwartz, 
1992) 

Ambivalent about attending training sessions (Mischo & Lee, 

1 987; Nicholas, et al., 1 986; Kirby & Miller, 1 986) 



Cost-conscious (Richardson, 1981; Bodtke-Roberts, 1983; Bell & 
Halperin, 1989; Nicholas, et al., 1986; Haynes, et al., 1991) 



Familiar with computers (Kirk, 1986; Hart & Rice, 1 991 ; Ikeda & 
Schwartz, 1992) 

Regular searchers (Hart & Rice, 1991 ; Ikeda & Schwartz, 1992) 

•Familiar with OPACs and printed indexing tools (Mischo & Lee, 
1987; Dalrymple & Roderer, 1994) 

-Domain experts (Nicholas, 1995; Cole & Bawden, 1996) 



Electronic gatekeepers (Richardson, 1981; Bodtke-Roberts, 1983; 
Nicholas, et al., 1986; Mischo & Lee, 1 987; Cole & Bawden, 1 996) 

•Mostly graduate students (Janke, 1984; Crooks, 1985) 



•Have little or no experience of using human intermediation 

(Poisson, 1986; Mischo & Lee, 1987) 



Plan to download the results for post-processing (Hart & Rice, 
1 991 ; Ikeda & Schwartz, 1992) 

-Have focused and practical information needs (Dalrymple, 
1990) 

-Cannot or unwilling to explain their information needs 

(Haines, 1982; Vollaro & Hawkins, 1986; Nicholas, 1995) 



Use fulltext or numeric databases (Eckersley & Rennie, 1984; 
Dalrymple & Roderer, 1994) 



-Physically remote from professional intermediaries (Vollaro & 
Hawkins, 1 986; Nicholas & Martin, 1 993; Nicholas, 1 995) 

-Have direct access to IR systems from own office or home 
(Vollaro & Hawkins, 1986; Lindberg, et al., 1993) 



Users of Human Intermediation 



Unwilling to leam search skills (Nicholas, et al., 1986; Vollaro & 
Hawkins, 1986) 

Satisfied with human intermediation (Richardson, 1981 ; Vollaro 
& Hawkins, 1986 ) 

-Have frustration of desire to read fulltext (Richardson, 1981 ; 
Arnold, 1982) 



Cost-conscious (Nicholas, et al. 1986; Sandore, 1990; Nicholas, 
1995) 

Do not want to spend their own time (Comick, 1989; Sandore, 
1990) 

-Other responsibilities demand their time (Richardson, 1981; 
Walton & Dedert, 1983; Harman, 1986) 



Unfamiliar with search systems (Hsu, 1 991) 

Lacking search skills (Hurt, 1983; Comick, 1989; Hsu, 1991; 
Nicholas & Martin, 1993) 

Infrequent searchers (Richardson, 1 981 ; Walton & Dedert, 1 983; 
Nicholas, et al., 1986; Bell & Halperin, 1989; Ikeda & Schwartz, 
1992) 

Forgotten how to perform a search (Richardson, 1 981 ; Walton & 
Dedert, 1983; Harman, 1986; Vollaro & Hawkins, 1986; Nicholas & 
Martin, 1993; Smith, 1993) 

-Cannot type (Richardson, 1981; Arnold, 1982) 

-Searching in an unfamiliar domain (Haines, 1982; Nicholas, 
1995) 



*Mostty graduate students (Comick, 1989) 



•Have some experience of using human intermediation 

(Comick, 1989) 





-Have no access to IR systems from their own office (Vollaro & 
Hawkins, 1986; Nicholas & Martin, 1993; Nicholas, 1995) 



— Females tend to delegate more than males (Nicholas & 
Martin, 1993) 



—Searching in an unfamiliar domain (Haines, 1982; Nicholas, 
1995) 



* findings only in academic environments - only in non-academic environments 
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Dimensions of User Characteristics 

In the following, each dimension of the user characteristics (situations and individual differences), as categorized 
in Table 2-2, is discussed with relevant models and findings. 

Motivation 

Users who conduct self-searching are characterized as enthusiastic about self-searching from the beginning 
and satisfied with self-searching regardless of outcome. They perceive themselves as self-sufficient and feel 
ambivalent about attending training sessions. These characteristics may not only be common characteristics 
of most self-searchers, but also imply that only those users who are highly motivated in self-searching volunteer 
to participate in surveys or quasi-experiments, two of the most frequently employed research methods in 
studying user self-searching. Even though they are motivated in conducting self-searching, small-scale case 
studies indicate that they are not willing to devote much time to learn how to use IR systems by attending 
formal training, but prefer one-to-one methods at the time when they have real search need, (Nicholas, et 
al.1986; Nicholas & Martin, 1993; Borgman, 1996). In fact, Hsu (1991) reports that more than 40% of faculty 
MEDLINE users at a medical college learned to perform self-searching by themselves. 

By contrast, users who make requests of intermediaries are not only unwilling to attend training sessions but 
also unwilling to learn search skills . They are satisfied with the use of human intermediation . 

Some users seem to delegate their search to professional intermediaries in expectatipn of obtaining evaluated 
and synthesized information, because they have frustration of desire to read fulltext. It sounds as if some users 
just don’t want to read fulltext documents. For example, engineers in an industrial environment who are 
looking for solutions to their technical problems tend to delegate. Richardson (1981) proposes that the common 
wisdom in library and information science is "engineers [do] not read" (p. 49). Similarly, managers who are 
looking for information required in making strategic decisions tend to prefer to delegate searching (Arnold, 
1982), because they want to receive digests or ideas rather than documents or references as the outcome of 
searches (Hall, 1977; Hall, 1981). Nicholas (1995) reports as one of the reasons for a member of the House of 
Commons in England he interviewed, not using in-house IR systems or services directly because of the 
frustration with anticipated massive output from online searching. This is because direct searching or even 
mediated searching leads them to the desire to read fulltext of the document. Thus, Arnold (1982) proposes 
information professionals be "able to add value to search results by summarizing and reporting" (p. 80) in 
helping managers using databases. 

Economic Considerations 

Users who perform self-searching are highly cost-conscious . This is particularly important among academic 
users usually charged for self-searching or mediated searching of commercial online services. Thus they shifted 
from mediated searching of commercial online databases to self-searching of locally mounted databases and 
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CD-ROM databases when they are available free of charge. Even in industrial environments in which users 
are not directly charged for their search, some of them are reported to be cost-conscious (Richardson, 1981; 
Nicholas, et al., 1986; Haynes, et al., 1991). On the other hand, Crea, et al. (1992) claim that the majority of 
direct-searchers of MEDLINE users (faculty, researchers and medical staff) at an academic medical library are 
not very cost-conscious ; because they do not remember how much they pay for their self-searching of online 
MEDLINE. 

Some users who use human intermediation are also found to be cost-conscious. Different from professional 
intermediaries, users tend to begin their search without sufficient preparation (f a nke, 1984), but rather browse 
extensively while searching (Fenichel, 1981; Haines, 1982; Nicholas, 1995). Thus, an average search session 
in commercial online IR systems may take a longer period of time for self-searching than for human 
intermediation and, therefore, be more costly in terms of both online connection costs and users’ time costs 
(Mischo & Lee, 1987). Therefore, users who do not want to spend their own time may delegate the search to 
information professionals. This is particularly true for users who think online searching is not their job and 
that other responsibilities demand their time. These users indicate that they want to use their time more 
efficiently than conducting self-searching (Richardson, 1981; Walton & Dedert, 1983; Harman, 1986). 

Knowledge and Skills 

Borgman (1996) argues that traditional query-based IR systems, such as OPACs and bibliographic IR systems, 
are "designed for expert librarian searchers who have a rich conceptual framework for information retrieval. . ." 
Most users lack the required "conceptual knowledge for searching" (p. 501). Borgman claims that three kinds 
of knowledge are required for traditional query-based IR systems. They are: 

• Conceptual knowledge of the information retrieval process - translating an information need into 
a searchable query; 

• Semantic knowledge of how to implement a query in a given system - how and when to use system 
features; 

• Technical skills in executing the query - basic computer skills and the syntax of executing queries 
as specific search statements (p. 496). 



The literature suggests that users who perform direct searching tend to have some of the above knowledge 
or skills. They are familiar with computers and/or familiar with OPACs and printed indexing tools. Because 
they are regular searchers, they can keep up with their search skills. On the other hand, users who use human 
intermediation are unfamiliar with search systems and/or lacking search skills. They may have learned how 
to do searches by attending training sessions or through observing intermediaries in mediated searching. But 
they have forgotten how to perform a search due to the fact that they are infrequent searchers. 
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Social learning theory suggests that individuals lacking component sub-skills may be unable to reproduce 
observed behavior (Weiss, 1990). A relatively old case study of user training in an industrial environment 
reports that one attendee of the training gave up direct searching because he cannot type (Richardson, 1981). 
Similarly, Arnold (1982) claims that one of the reasons corporate managers delegate searches is because they 
"don’t know how to type and won’t learn" (p. 78). Though today’s increased demand for using computers in 
educational and work environments may mean more people can now type, the above example illustrates the 
importance of component sub-skills in performing self-searching. 

Users who perform self-searching are domain experts of the topic on the search. Traditionally, users of human 
intermediation were considered as having better domain knowledge of the topic of the search (Lancaster, 
1969; Barber, et al., 1973; Richardson, 1981; Bodtke-Roberts, 1983; Saracevic, et al., 1988; O’Day & Jeffries, 
1993a; 1993b; Spink, 1997b). But the literature suggests that some users make requests of human intermediaries 
only when they are searching in unfamiliar domains (Haines, 1982; Nicholas, 1995). Thus, the association 
between the level of domain knowledge held by users and generation of either mode of IR interaction remains 
controversial. 

Both domain knowledge and knowledge of information need play significant roles in relevance judgment 
(Cuadra & Katter, 1967; Rees & Schultz, 1967; Lancaster, 1969; Schamber, et al., 1990; Spink, 1997b) and post- 
search information processing (Richardson, 1981; O’Day & Jeffries, 1993a, 1993b). A user who has generated 
an information need, by definition, is in a better position than anyone else to make a relevance judgment 
regardless of whether he has extensive domain knowledge or not (Lancaster, et al., 1994). But, if s/he has 
good domain knowledge of the topic of search, then s/he should be able to gain the best outcome by directly 
examining the search results. On the other hand, professional intermediaries who lack extensive domain 
knowledge tend to prefer users to stay with them during IR sessions (Richardson, 1981; Sandore, 1990; Spink, 
1997b) probably because they can rely on users' domain knowledge and ability to make relevance judgments. 

Role and Status of Users 

The literature of user training reports the emergence of electronic gatekeepers among users who perform IR 
session on behalf of other users either voluntarily or by assignment. However, no empirical studies examined 
focused on the actual search process performed by non-professional intermediaries or reasons for people to 
make search requests of these electronic gatekeepers. 

Early studies of user of self-searching and human intermediation in academic environments are mostly graduate 
students. Large-scale surveys of attendants of user training sessions and patrons of mediated online search 
services found that the majority of users are graduate students. In addition, the majority of volunteers 
participating in quasi-experiments comparing self-searching with human intermediation in academic 
environments are also graduate students. However, participants in recent observational studies of naturalistically 





Use of Human Intermediation In Information Problem Solving: A User's Perspective 



occurring user self-searching processes represent both undergraduate and graduate students equally. Since it 
is quite reasonable to assume that the majority of users of academic libraries are students, these characteristics 
may simply reflect the general configuration of user population in academic environments. 

On the other hand, faculty and staff who generate either or both self-searching and human intermediation are 
under-represented in empirical studies of academic environments. However, it is not clear whether this is 
because they don’t attend training sessions and tend to access IR systems from their own offices rather than 
in libraries where observational studies are conducted or because they do not use IR system often to locate 
information due to the fact that they have developed other ways of getting necessary information, as suggested 
by Ellis (1989a, 1989b). It might be the case that they do not perform self-searching by themselves but ask 
non-professional intermediaries such as graduate assistants or secretaries to do it for them. Even though Mischo 
and Lee (1987) report that some graduate students are acting as intermediaries for research projects with faculty 
members, no study examined for this literature review inquires into faculty use of graduate students as 
intermediaries in IR interaction. 

Experience of Usitig Human Intermediation 

The literature reports that users of self-searching in academic environments have little or no experience of using 
human intermediation. On the other hand, users who generate human intermediation have some experience 
of either self searching or mediated searching. These findings implicitly suggest that different populations of 
users select different modes of JR interaction. However, some empirical evidence suggests that the same user 
generates both self-searching and human intermediation (Haines, 1982; Veenstra, 1992; Crea, et al., 1992; 
Dalrymple & Roderer, 1994; Nicholas, 1995). 

Nature of Information Needs and Use Orientation 

Different types or levels of information needs may be associated with the choice between self-searching and 
human intermediation. Dalrymple (1990) reports that users who conduct self-searching have more focused and 
practical information needs than those who use human intermediation. On the other hand, users perform self- 
searching because they cannot or are unwilling to explain their information needs. For example, faculty 
members in biology observed and interviewed by Bodtke-Roberts (1983) prefer direct searching of BIOSIS 
because they do not need to explain to someone not in the field (i.e., a librarian) about their research and 
their information needs. Nicholas 0995) reports that some political staff at the UK Parliament prefer self- 
searching for politically biased information needs and that some journalists tend to perform self-searching for 
idea-generating information needs. Salovaara (1988) found that some "rather superficial information needs" 
were never asked to be fulfilled by professional intermediaries (p. 109). Also, users tend to perform self- 
searching when they plan to download the results for postprocessing. 
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Type of Database Used 

Users who use fulltext or numeric databases tend to perform self-searching. Fulltext databases of commercial 
online services aimed at the legal professionals, such as LEXIS and WESTLAW, have been searched directly 
by users in the legal community especially after the introduction of natural-language search interfaces 
(Dalrymple & Roderer, 1994). Similarly, econometric databases have been directly searched by industrial 
economists, who are acting as intermediaries and are delegated the access and manipulation of data by their 
superiors (McKersley & Rannie, 1984). Cole & Bawden (1996) also found that free or inexpensive factual data 
in the field of pharmaceutical research such as GenBank and EMB on the Internet have been widely searched 
directly by industrial users. 

Several reasons may explain the popularity of direct searching of fulltext and numeric databases among users. 
First, these databases are less structured compared to bibliographic ones. Therefore they do not require 
sophisticated search skills or use of controlled vocabularies. Second, fulltext and numeric databases provide 
raw data rather than meta-data. Thus direct-searchers can obtain and use information quickly by reading, 
evaluating, extracting and processing interim search results while interacting with the 1R system. This is because 
real-time processing of interim search results requires domain knowledge as well as knowledge of the 
information need and/or planned use. Users have an advantage over professional intermediaries who tend 
not to have either domain knowledge or knowledge of information needs. However, whether users rely on 
non-professional intermediaries in searching fulltext databases is unknown. 

« 4 

Accessibility 

Self-searchers in non-academic environments tend to be physically remote from professional intermediaries , 
but have direct access to IR systems from their own office or home. By contrast, those users who generate human 
intermediation have no access to an IR system from their own office. These characteristics are explained by the 
well known "least effort principle" suggesting that people prefer more accessible and convenient information 
sources and tend to spend the least effort possible in completing their IPS tasks (Poole, 1985). 

Individual Difference 

Nicholas & Martin (1993) suggest that gender makes a difference. He reports that female journalists tend to 
delegate more than male counterparts. However, he does not offer any explanation for the difference. Nicholas 
(1995) reports that older journalists tend to perform direct searching more effectively than younger ones. He 
attributes the success of older journalists to their longer job experience. 

Situationality 

Some of the characteristics presented above suggest that different groups of users select either self-searching 
or human intermediation consistently. However, the literature reports that the same users generate both self- 
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searching and human intermediation depending upon the situation (Haines, 1982; Veenstra, 1992; Crea, et ah, 
1992; Dalrymple & Roderer, 1994; Nicholas, 1995). 

Haines (1982) reports reasons for self-searchers to occasionally use human intermediation such as for searching 
in an unfamiliar domain and for more complex and difficult searches. Similarly, Nicholas and Martin (1993) 
report that journalists tend to perform straightforward searches by themselves and use human intermediation 
for difficult searches. 

One of the situational factors that may determine users' selection of a search mode is their search stage in the 
IPS process. Crea, et al. (1992) suggest that users in academic medical libraries make search requests of 
information professionals or ask colleagues and/or staff to search for them if they cannot find needed 
information through self-searching. Similarly, Sandore (1990) reports that academic users of the fee-based 
online search service of a public library tend to make requests of human intermediaries after they have 
attempted to locate information by themselves. By contrast, business users in Sandore’s research have seldom 
made any prior efforts to locate information by themselves. She attributes the difference to cost and time factors 
- academic users who pay for the search by themselves opt to save money, while business users whose 
company pays for the search tend to appreciate saving their time. 

The multiple search session model proposed by Saracevic, et al. (1991), and replicated by Spink (1993) suggests 
that users generate multiple search sessions within their single IPS process. Kuhlthau, et al. (1992) try to capture 
the evolving nature of multiple sessions within Kuhlthau’s model of information search process (ISP). They 
advocate that the results of previous 1R interaction may alter the original information needs, generating a 
successive chain of JR interactions in an IPS process. Existing studies of multiple sessions have captured the 
occurrence of either multiple self-searchings or multiple human intermediations within an IPS process. But 
multiple sessions involving both self-searching and human intermediation may occur within an IPS process if 
users' information needs evolve through repeated IR interaction. Applying Taylor's (1968) model of question 
negotiation process , a user may conduct self-searching first, ask help or make a search request of colleague 
and/or subordinate second, and make a search request of the professional intermediary (librarian) last. 

Conclusions Concerning User Characteristics 

Research findings concerning user characteristics of the human intermediation are contradictory. The literature 
implies that the selection between self-searching and human intermediation is a product of a variety of factors. 
Factors identified include both personal and social/environmental aspects. They are: the user’s motivation; 
economic (time and money) considerations; experience of different modes of IR interaction; accessibility to 
IR systems and/or human intermediaries; skills and knowledge of the user and the intermediary; the status of 
and relationship between the user and the intermediary; types and number of databases used; and individual 
differences of the user such as gender, age and job experience. For users in the environment in which ready 
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access to both IR systems and human intermediaries is available, the selection seems to be associated not only 
with the internal state of cognition and affection (e.g., knowledge, skills, feeling, nature of information need 
and information use orientation, the results of previous searches in the same IPS process, etc.) but also external 
conditions (e.g., accessibility of IR systems and human intermediaries, users’ status and interpersonal 
relationships with intermediaries and other people in the environment, etc.). 

CONCLUSION ON FINDINGS OF 
RESEARCH IN HUMAN INTERMEDIATION 

The existing literature on human intermediation is limited because it tends to represent the perspective of 
professional intermediaries. In addition, existing research in human intermediation is concentrated on the use 
of bibliographic databases, while other types of databases such as fulltext, graphic and numeric ones are 
neglected. Under such limitations, the literature establishes the following: 

• Search process variables of users and professional intermediaries, such as efforts spent on preparation 
and the level of interactivity, do not necessarily reflect superiority of either users or professional 
intermediaries. Rather, they seem to reflect a variety of situational variables such as level of 
knowledge and experience as well as individual difference variables. 

• The literature provides some description of tasks performed by professional intermediaries in 
mediated searching in which the users are present during search sessions (Fidel, 1981; Saracevic, 
et al., 1991; Spink & Saracevic, 1997). The literature also provides some description of what is going 
on in users’ minds in self-searching of bibliographic and fulltext databases (Marchionini 1995; Hert, 
1995). However, the literature informs very little on what is done by intermediaries in the way on 
post-logoff activities. 

• The literature reveals some characteristics of users who use human intermediation. Some of these 
characteristics, such as motivational and other individual differences, may suggest that human 
intermediation is constantly used by particular users. On the other hand, the literature informs us 
that a variety of situational variables are associated with the use of human intermediation. Some of 
these situational variables, such as the nature of the information need and information use orientation, 
knowledge, and stage of the IPS process (results of the previous search) may reflect users’ internal 
states. Others, such as the role of users in IPS, economic considerations of time and money, as well 
as accessibility to IR systems and/or professional intermediaries, seem to reflect social and 
environmental situations as well. In addition, literature reports that the same user conducts self- 
searching and uses human intermediaries depending upon the situation (Nicholas, 1995). 
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The lack of research on tasks requested of human intermediaries, particularly of post-search information 
processing, confirms the necessity to answer the first research question ( what kind of tasks do users request of 
human intermediaries P) in order to establish the distinction among tasks users requests of human intermediaries. 

Findings on characteristics of users who generate human intermediation imply the importance of situational 
factors. These Findings suggest that the situational factors may reflea users’ internal states as well as social and 
environmental settings. However, the literature does not provide a good understanding of the association 
between these faaors and the users’ decisions of using human intermediation, but rather contradiaory findings. 
Moreover, these findings tend to be the by-products of studies focused on other aspects of IR or IPS behavior. 
No literature reviewed has focused on faaors associated with the use of human intermediation. Therefore, the 
second research question asked in this research is unique and important. If distinction can be made among 
different tasks requested of human intermediaries, there may be patterns between situations of users and tasks 
they request. Thus, the third research question is meaningful. 

CHAPTER CONCLUSION 

The intention of this chapter was to review the topics in IR and IPS research considered relevant for the study. 
The aims of the literature review in this chapter were: 

• To justify the choice of research topic, 

• To define key concepts, and 

• To identify findings and models relevant to this study. 



The result was synthesized as follows: 

Empirical evidence was provided that some users are still relying on human intermediaries in carrying out 
their IR tasks even though they have direa access to IR systems. But the literature did not provide sufficient 
empirical evidence to clarify what tasks are expeaed of intermediaries in human intermediation, or, why and 
in what situation users rely on intermediaries. 

Key concepts are defined with their relationships in order to establish the focus of and the viewpoint taken 
by the study. IR systems were defined broadly to capture the recent growth and diversification of elearonic 
environments. Human intermediation was defined as a particular aaivity encompassed in an IPS process in 
order to capture the context. A distinaion was made on the role of users in IPS process, in order to take into 
consideration the situational dynamics of human information behavior. 
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Major assumptions central to this study were identified and justified. They are: 

• Users may request a variety of tasks to human intermediaries in carrying out their IPS processes for 
a variety of reasons not limited to their internal (cognitive and affective) but also including external 
(social and environmental) conditions. 

• For human intermediation to be seen as an activity encompassed within an IPS process, further 
examination of the information use component is necessary. The function of information analysis, 
required to produce evaluated information to the point of use, seems to be the key. 

• Users actively make choices, consciously or unconsciously, in selecting between self-searching and 
human intermediation. Thus, the major determinants in the selection are perception of internal and 
external situations and intentions of users. 



Human IPS behavior is complex, particularly when involving other people such as intermediaries. Despite the 
massive literature of models and findings in IR and IPS research, the field has not yet achieved an adequate 
understanding of how the human mind works in generating and carrying out IR and IPS processes (Taylor, 
1986). Besides, this research uniquely defined key concepts to emphasize the perception and intention of 
users. Thus, this study should be seen as an initial attempt to inquire into a new area of research, rather than 
a mere extension of existing studies conducted around human intermediation. 

Such recognition guided this research to take an exploratory approach. At the same time, this research used 
existing models and findings as guides for research design and data collection in order to take advantage of 
the cumulative nature of scientific research. 





CHAPTER 

THREE 



SEARCH FOR 
THE OPTIMAL 
APPROACH 



This chapter reviews the assumptions and the approach in conventional IR and IPS research in order to identify 
and justify the most appropriate approach for this study. Because of the complexity of human intermediation 
in IPS processes that involve multiple actors (i.e., users, intermediaries, and IR systems), this phenomenon 
could be approached from a variety of perspectives. The approach selected for this study takes users’ 
perspective and focuses on the use of human intermediation as a particular activity encompassed in an IPS 
process. Thus, this research posits human intermediation in the broader context of information need, as well 
as information use as seen by the users. 

First, the assumptions underlying this study are presented. Second, different approaches in library and 
information science (LIS) concerning IPS and IR research are examined. Finally, a preliminary framework 
developed for the purpose of this study based on the literature will be presented. 

ASSUMPTIONS OF THIS STUDY 

Despite a great deal of literature on IR and IPS research, it does not provide sufficient understanding of human 
IPS behavior in general and human intermediation in particular. Based on the review of literature concerning 
human intermediation (Chapter 2), potential sources of such limitations are: 



• The lack of distinction among different types of tasks requested of and performed by human 
intermediaries in human intermediation, 

• The lack of research integrating IR and IPS processes, particularly in the use of human intermediation, 

• The lack of empirical research that captures human intermediation from users’ perspectives. 
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In order to overcome the above limitations, this research makes the following assumptions: 

• The tasks requested of human intermediation may correspond to tasks presented in IPS process 
models. 

• Use of human intermediation is a particular activity encompassed in the broader context of IPS 
processes. 

• Users actively make choices, consciously or unconsciously, in selecting between self- searching and 
human intermediation in response to their personal (internal) and social/environmental (external) 
situations - they behave differently according to their perception of themselves as well as of their 
environments. Thus, the examination of both internal and external situations, as perceived by users, 
relevant to the context of the IR interaction is necessary. 



The above assumptions are bases for selecting an appropriate approach for this research. 



Table 3-1: Implicit Assumptions of System-Centered and User-Centered Perspective* 





System-Centered Perspective User-Centered 

_ 


Perspective 


Information 


Objective entity such as channels (e.g., oral, 
written, formal, informal. Etc.) or sources (e.g., 
library, book, index, people, database, etc.) with 
which the user interacts. 


Subjective construct that may change the 
structure of user's knowledge. It is the actual 
meaning constructed by the receiver from the 
message. 


User 


A person who puts a demand or makes use of 
information channels or sources, and is 
describable in terms of demographic variables 
without taking into account the context of use. 


An active processor of information; a purposive, 
self-controlling, and sense-making being in a 
particular time and space. 


Information need 


When the user uses a source or channel, that 
behavior is interpreted as an information need. 
Thus, it is manifested within the limit of what 
channels or sources are available to the user; 


That which induces information-seeking 
behavior. It may reflect physical, cognitive, social 
and/or affective needs. 


Information use 


The access to channels or sources; substantive 
content extracted from the channel or sources 
and the ends served by it are outside the scope. 


The end served by information, the meaning 
constructed by the receiver from the content of 
messages received by the user which changes 
the structure of his knowledge: e.g., ideas 
generated, decisions made, actions taken, etc. 


Information behavior 


Focuses on externally observable behavior of 
users' interaction with systems across situations. 


Focused on the internal and/or social interaction 
beyond interaction with systems to include the 
points where use and effects occur; emphasize 
situationality of information behavior. 



* Developed based mainly on Dervin & Nilan (1 986), Taylor (1 986), Savolainen (1 993), Wilson (1 981 ; 1 997), Ellis (1 989a, 1 989b) and Sugar (1 995). 
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TWO PERSPECTIVES IN IR AND IPS RESEARCH 

Two sets of contrasting perspectives co-exist in the research tradition of LIS: (1) the system-centered perspective 
which emphasizes the needs of systems, and; (2) the user-centered perspective which emphasizes the needs 
of users. Nevertheless, both perspectives ultimately seek to develop optimal information systems and/or services 
that respond to users’ needs. 

Each of the two perspectives implicitly makes different assumptions for central concepts of IPS and IR, including 
information, user, information need, information use, and information behavior. Though assumptions made 
by different approaches in each of the two perspectives vary slightly, the general assumptions of the two 
perspectives may be synthesized as presented in Table 3-1. 

In short, the system-centered perspective posits users as passive receivers of objective information such as 
channels or sources and their interaction with the IR system as an input-output process, hence focusing on 
capturing observable information behavior across situations. The user-centered perspective, on the other hand, 
assumes users as active processors of information who construct meaning through their social and/or personal 
interaction beyond the limitations of particular information systems and emphasizes the situationality of human 
information behavior. Since this study assumes active users who make the choice between self-searching and 
human intermediation depending upon internal and external situations, the user-centered perspective is the 
obvious choice. 

The following section compares and contrasts three different approaches in the user-centered perspective, in 

r 

the search for the optimal approach for this study. 

DIFFERENT APPROACHES IN USER-CENTERED PERSPECTIVE 

Several different approaches are observed in the user-centered perspective. Based on the synthesis of the 
literature, categorized roughly into three groups: (1) cognitive approaches that emphasize the knowledge 
structure and thinking process of users involved in IPS and IR process; (2) constructive approaches that 
emphasize both cognitive and affective dimensions of individual users; and (3) social approaches that emphasize 
social aspects and shared value among a group of users in addition to cognitive and affective states of individual 
users (Table 3-2). As may be found in the following, the three categories are neither mutually exclusive nor 
exhaustive. 

The approach of this research requires: (1) to capture IPS as a process in which human intermediation is a 
part, (2) to cover cognitive as well as affective aspects of IPS behavior; and (3) to account for 
social/environmental aspects. The requirement of accountability for social/environmental aspects is particular 
to the second research question ( What situational factors do users perceive to be salient when they make requests 
of human intermediaries ?). However, before asking the second research question, answering to the first 
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Table 3-2: Approaches In User-Centered Perspective of IPS and IR Research 



Approaches 


Characteristics of the Approaches 


Examples of Researchers/Models 


Cognitive approaches 


Emphasize the knowledge structure and thinking 
process of individual users. 

Attempt to explain both internal and external 
information behavior of a user in relation to what 
the user thinks and knows. 


Static frameworks (Borgman, 1986; Allen, 1990; 
Jacobson, et al., 1993; Ford, et al., 1994) 

Dynamic frameworks (Oddy, 1977; Belkin, et al., 
1982a, 1982b; Daniels, 1987; Ingwersen, 1992) 


Constructive 

approaches 


Emphasize both cognitive and affective 
dimensions of individual users. 

Attempt to explain internal and external 
information behavior of a user in relation to what 
the user thinks, knows and feels. 


Sense-Making (Dervin, 1983; Dervin & Nilan, 
1986; Newby, et al., 1991) 

Information Search Process (ISP) (Kuhlthau, 
1992) 


Social approaches 


Emphasize both cognitive and affective 
dimensions shared among a particular group of 
users. 

Attempt to explain collective information behavior 
of a group of users in relation to their social 
interaction, environmental conditions and/or to 
share value among the group of users. 


Value-Added Model (Taylor, 1986) 

Parameters of Value (Hall, 1 977) 

Life in a Small World (Chatman, 1991) 

Behavioral Approach Taken by Sheffield School 
(Wilson, 1997; Wilson, 1990; Ellis, 1989a, 
1989b) 

Social Informatics (Karamuftuoglu, 1998; Cool, 
1997) 



research question ( What kind of tasks do users request human intermediaries ?) is necessary due to the lack of 
distinction among tasks requested of human intermediaries. Since these two questions are asked in this study, 
the approach taken by the study should be consistent. Thus, this research requires taking an approach that is 
accountable for social/environmental aspects of human IPS behavior. Thus, the social approach seems to be 
the most appropriate choice for this study. 

COGNITIVE APPROACHES 

Insomuch as knowledge is concerned, the cognitive approaches assume that different users behave differently 
for their IPS under a similar situation because of their different cognitive structures developed through different 
past experiences. Hence, they may interpret the identical situation differently. Even though there has been an 
ongoing debate among researchers on whether the affective dimension should also be included, this study 
takes the position that the affective dimension is external to the cognitive approaches following Allen (1996). 

Within the cognitive approaches, there are two alternative views concerning the stability of the user’s information 
needs throughout IR interaction: the static framework and the dynamic framework The static framework does 
not take into account changes that might occur in users’ information problems during IR and IPS processes. 
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By contrast, those who adopt a dynamic framework explicitly account for the changing nature of information 
problems, particularly in response to the encounter with new information in IR interaction or the IPS process. 
Theoretical details and examples of research in each framework are extensively reviewed by Hert (Hert, 1995). 

Static Framework 

According to Hert (1995), one area of the static view of the cognitive approach focuses on individual differences. 
For example, Borgman (1989) proposes that academic orientation, technical aptitudes and other personality 
variables are related to IR performance. Allen (1990) demonstrates the relation between cognitive structure 
and selection of keywords. Jacobson, et al. (1993) shows that computer familiarity, knowledge of database 
and domain knowledge, when combined, are related to IR performance. Ford, et al. (1994) demonstrate the 
relation between users’ learning styles and the search strategy they use. The efforts in this area, however, have 
not yet achieved sound theoretical explanations (Saracevic, 1991). 

Dynamic Framework 

On the other hand, researchers who take the cognitive viewpoint assume the dynamic nature of information 
needs and propose seeing IR interaction as a communication process. This receiver-oriented framework has 
been developed through the anomalous state of knowledge (ASK) hypothesis , which stresses the inability of 
users to describe their information needs accurately and completely (Belkin, et al., 1982a, 1982b). Researchers 
in this vein concentrate their efforts on the development of dynamic user models to be employed in IR system 
design (Belkin, et al., 1987; Daniels, 1987; Ingwersen, 1992) 

Even though knowledge of users may be associated significantly with their selection between self-searching 
and human intermediation, either of the above cognitive approaches is too limiting for this study. The static 
framework does not explicitly admit the operation of situational factors in IR and IPS behavior, while the 
dynamic frameworks till takes little account of the affective dimension presumably linked to social aspects. 

CONSTRUCTIVE APPROACHES 

Researchers who take constructive approaches incorporate both cognitive and affective dimensions, but of 
individual users. They tend to see IPS behavior from users’ personal constructs without explicitly taking into 
consideration social and environmental aspects that might be associated with users’ IPS behavior. Two such 
approaches examined in the following are sense-making and information search process (ISP). 

Sense-Making Approach 

Dervin and her colleagues (Dervin, 1983; Dervin & Nilan, 1986) have developed and implemented the sense- 
making theory with its unique methods of time-line interview. This theory relies heavily on the constructivist 
theory of discontinuity condition which prompts individuals to take steps to construct sense in ever-changing 
life situations (Dervin & Nilan, 1986). Sense-making theory regards IPS as communication behavior - both 
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internal and external - in which the individual user constructs and designs his movement thorough time/space 
by making sense out of the discontinuity. Thus, this approach is capable of capturing a variety of information 
behavior including information seeking, processing, creating and using (Savolainen, 1993). Also, this approach 
deals with the affective dimension as well as the cognitive dimension of the user’s perception, particularly 
when it operates on the "situation movement state" - the main indicators to describe the triggering situation. 
It captures "the inverse relationship between the amount of anxiety the respondent feels at a particular point, 
and the amount of control s/he thinks s/he has" (Newby, et al., 1991, p. 75) over the situation. 

However, this approach seems to be unable to account for the reciprocity of social action. Savolainen (1993) 
argues that the approach does not take into account explicitly the possibility that outcome of social action is 
tied to particular occasions and to other participants in the situation even though social conduct displays itself 
as contingent upon the conduct of others. Though this approach assumes the existence of patterns or regulations 
in how people approach IPS at a meta level, it tends to capture the situation as an internally constructed reality 
by a particular information seeker at a particular time. Such individualistic conceptualization of situationality 
limits the applicability of this approach to IR and IPS behavior in organizational environments in which social 
interaction may play an important role. 

Methodologically, the sense-making approach seems to have another limitation for this study that intends to 
capture IR interaction encompassed within an IPS process. Namely, the sense-making methodology tends to 
capture a particular IPS behavior in a particular situation at a particular time - only when the user perceives 
a gap - the unit of analysis is on gap level. Therefore, the approach might be limited for this study that intends 
to capture IR and IPS as a process. 

Informaticm Search Process (ISP) 

Kuhlthau (1985; 1988) empirically developed a model of information search process (ISP) of college-bound 
high-school seniors based on Kelly’s (1963) personal construction theory. The theory proposes that people 
construct their world through the process of constant learning. The resulting information search process (ISP) 
model (Kuhlthau, 1992) incorporates behavioral, affective and cognitive aspects of constructive learning into 
the students IPS of six stages: (1) initiation, (2) selection, (3) exploration, (4) formulation, (5) collection, and 
(6) presentation. Throughout these stages, students’ thoughts change from vague into focused with increasing 
interest, their action from seeking relevant information into seeking pertinent information, and their feeling 
from (1) uncertainty, (2) optimism, (3) confusion, frustration and doubt, (4) clarity, (5) sense of direction and 
confidence, into (6) satisfaction or disappointment. This model has been validated in a variety of educational 
settings (Kuhlthau, 1989; Swain, 1996). 

This approach fulfills two of the three requirements of the study - it covers behavioral, cognitive as well as 
affective aspects of IPS process and it captures IPS as a process. However, development and validation of the 
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model is based mostly on empirical research in educational settings in which the focus is to help students 
learn IPS skills in order to make them self-help information processors. The purpose of IPS in work situations, 
the context included in this study, is not necessarily to help users learn IPS skills but rather to help them solve 
their information problems with optimal efficiency and effectiveness (White, 1992). In addition, Kuhlthau’s 
(1992) ISP model is based on a rather individualistic view and is therefore unable to account for social aspects 
of IPS behavior. Thus, even though the approach itself seems rigorous, the theory Kuhlthau based it on as 
well as the resulting model of ISP seems too limiting for this study. 

SOCIAL APPROACHES 

Several researchers emphasize the social and environmental aspects, in addition to personal aspects, in 
determining the IPS behavior of users. Researchers who take shared-value approaches emphasize the impact 
of values and norms shared among a group of people on their IPS behavior. Such emphasis is also common 
among researchers of the Sheffield school who take so-called user-based behainoral approaches . 

Shared Value Approach 

This approach focuses on the perception of utility or value brought by a group of users to information sources, 
systems and services. Researchers who take this approach assume the existence of shared values in evaluating 
information or information systems/services. They also admit the operation of shared norms among a group 
of people in determining the appropriateness of their information behavior. Several different versions are 
observed including the value-added model ( Taylor, 1991; 1986; MacMullin & Taylor, 19 84), parameters of value 
(Hall, 1977; 1981), and life in a "smallworid" (Chatman, 1991; 1996). 

Value-Added Model 

Taylor (1986) proposes the value-added model , a descriptive model that captures a full spectrum of information 
systems and services including functions of human intermediaries. The central notion of this approach is to 
see information systems and services as "a series of formal processes by which the potential usefulness of 
specific input messages being processed is enhanced” to meet the requirement of users (p. 6). Two fundamental 
premises underlying the value-added model are: (1) it is concerned about the praxis of information organization, 
processing and provision, and (2) it stresses the user-driven approach as a major input to system design, 
complementing the content-driven and the technology-driven models. Thus, even though the model has been 
developed based on analysis of formal processes of information systems and services and on the review of 
the literature describing the practice of information professionals 1 , the approach emphasizes seeing such 
processes based on a user perspective. Assumptions behind the model are: (1) people make choices, 
consciously or unconsciously, in using information systems and/or services; and (2) all functions performed 
by information systems and services are adding value to potential information in order to meet the user criteria 
or values in such selection. 

* The value-added model was developed based on the user criteria and values added to information systems and services elicited from examination of the abstracting 
and indexing process, and synthesizing the observations and experiences of skilled professionals as wefl as the literature (Taylor, 1 986). 
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Following the Rouses (Rouse & Rouse, 1984), Taylor emphasizes the user value of information as the "central 
theoretical issue" (p. 135) of human IPS processes. He argues that even though users ask questions to IR 
systems or human intermediaries, the users may not be interested in simply receiving answers, but rather in 
addressing information problems (Taylor, 1968; Taylor, 1986). Thus, topically relevant messages presented by 
IR systems or human intermediaries in response to users' questions may have potential for value, but the 
messages become useful information only after being examined by the user based on criteria of values 
associated with users' information problems. Value of information in the value-added model is not limited to 
"exchange value" in a pure economic sense but rather has to do with "apparent value" - "what a user is willing 
to invest in terms of energy, time, lost opportunity and dollars for the information" (p. 19). 

The user-driven approach of the value-added model emphasizes the shared value of a group of people. Taylor 
(1986) argues that the estimation of the user criteria or value in determining the usefulness of information 
requires an understanding of user context and/or his information problem within which information is sought 
and used. In order to obtain such understanding, questions of the user perception of her/his world and 
information behavior are unavoidable. Similarly, the effect of information on organizational context, such as 
performance or decision-making, is also unavoidable. User value, in this context, has to do with the benefit 
a user or an organization accrues as a result of obtaining and using information. Different groups of people 
(e.g., lawyers and managers) of the same organizational environment (e.g., a company) may evaluate a message 
given for the same question differently due to the differences in the nature of information problems they 
typically deal with. Thus, the differences in common information problems of a particular group of people 
are associated with their shared criteria in evaluating information (or information systems or services). 

Based on the above arguments, Taylor (1986) proposes that the "major input to the design of information 
systems must come from the analysis of the information use environment 1 or IUE, which "establishes the 
condition of flow into, within and out of many particular entities," and "determines the criteria by which the 
value of the information message is evaluated." (p. 3), and provides a set of criteria to be used in evaluating 
information systems (see Appendix B5). He proposes that IUE can be described with four categories: set of 
people; characteristics of typical problems; setting; and resolution of problems. Using the framework of IUE, 
MacMullin & Taylor (1984) identified and described a variety of situationally based problem dimensions (e.g., 
design/discovery; well-structured/ill-structured; complex/simple; etc.) and various information traits (e.g., 
quantitative continuum; data continuum; temporal continuum; etc.). By so doing, they explore the fit between 
the users’ problems and their expected use of potential information. Taylor (1991) further analyzes three 
information environments of engineers, legislators and practicing physicians in information terms to elicit the 
four categories of their IUEs. 
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Because of the limitation in existing IR systems built on technology- and content-driven models 2 , there is some 
distance between the output of IR systems in response to users' questions and the resolution of their information 
problems (or actual needs of users). Taylor (1986) calls this distance the "negotiating space" which is filled by 
"a range of intermediaries including analysts, knowledge experts, and consultants, who massage, combine 
manipulate, and interpret information to fit the problem needs of* users (p. 9). He argues that "the dynamics 
of the negotiating space in a very real sense define the time, efforts initiative, and even dollars a [user] must 
invest (cost) in order to extract information of use from the system (benefit)." He proposes to analyze 1UE in 
order to obtain ‘the understanding of and options within the negotiating space" (p. 33). 

Parameters of Value 

Hall (1977; 1982) explores the value system on which the users base their choices in purchasing and selecting 
commercial information services. They include access tools (i.e., indexes, abstracting services, and computer 
databases), information search services (i.e., those which provide searches for known facts for pre-defined 
questions); and information analysis services (i.e., those in which the user relies upon someone else both to 
find and to analyze the information available.) Based on a series of studies of industrial researchers using 
survey, interview and observation, he found that the variable that controls the decision is the function of the 
use rather than individual users defined by occupation or job title. 

Hall (1977) examined different parameters of value for information (e g., specificity, depth vs. breadth, 
timeliness) and how the kinds of information that would serve each value parameter might vary with different 
situations. He claims that "a given person may be acting as a scientist today, a searcher tomorrow, and a 
planner the next afternoon, and [that] the service he prefers will depend on his function at the moment." He 
maintains that "managers or users of information services whose function at the moment is research or operation 
or planning may attach different connotations to the same key words such as useful information, pertinence 
vs. relevance, depth vs. breadth, timeliness, time, and costs" (p. v). His findings suggest that users in the 
research function prefer original documents and tend to emphasize subjectivity. Whereas, those in the planning 
function often want a digest of ideas, not documents or reference, and tend to judge a service first according 
to its reliability. By contrast, those in operation functions are satisfied with abstracts and emphasize quantifiable 
factors such as time and money. 

Life in a Small World 

As opposed to the two previous versions of shared-value approaches ; both of which focus on information 
behavior in an organizational context, Chatman’s (1991) life in a small ivorid is based on her inquiries into 
information poverty. Through a series of studies of janitors, single mothers, and elderly populations, she 



2 Technology-driven models are based on limitation in "the size, shape, dynamics, and even the content" of technology-driven systems due to the nature of the technology 
(e.g., books, computers, etc.), which affect ways of storing, accessing and disseminating potential information (Taylor, 1986, p. 23), while content-driven models, derived 
from the traditional classification of knowledge and associated subject-based indexing, have "established the boundaries and objectives of content-driven systems" 
(Taylor, 1986, p. 25). 
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developed a set of concepts that capture the life-world of information-poor populations: risk-taking, secrecy, 
deception, and situational relevance. She claims that because of their low social status, insiders of the small 
world "reinforce information poverty by neglecting to accept sources of information not created by themselves." 
(Chatman, 1996, p. 193). Even though quite different from the previous two approaches which posit IPS in 
organizational settings, her findings also support the notion of shared information value - the legitimacy of 
information behavior is largely determined by social and cultural norms and mores. 

Behavioral Approach Taken by Sheffield School 

Wilson and his colleagues (Wilson, 1981, 1990, 1997; Wilson & Streatfield, 1981; Ellis, 1989a, 1989b) of the 
"Sheffield School" advocate a user-centered behavioral approach to IPS, employing qualitative and observational 
methods as the alternatives to the traditional positivistic "normal" science approach to user studies. The 
behavioral approach of the Sheffield School emphasizes the following: 

• Focus on IPS behavior rather than information need or use. 

• Situationality is a crucial aspect in identifying patterns of IPS behavior. 

• Situationality and characteristics of IPS behavior may be shared among people who are working in 
the same or similar environment. 

• Social and cultural aspects of information environments develop shared norms and values of people. 
These aspects are important for a deep understanding of their IPS behavior. 



Even though their approach emphasizes observable IPS behavior rather than internal (cognitive or affective), 
Wilson (1981) stresses the significance of social aspects that may link cognitive and affective dimensions of 
individual information behavior. He proposes that: 

Because the situations in which information is sought and used are social situations, [italics in 
original] however, purely cognitive conceptions of information need are probably adequate for 
some research purposes in information science, but not for all. Information may also satisfy 
affective needs, such as the need for security, for achievement, or for dominance... while the 
nature of the organization, coupled with the individual's personality structure, will create affective 
needs such as the need for achievement, for self-expression and self-actualization. The particular 
pattern of needs and the resulting form of information-seeking behavior will be a function of all 
of these factors, plus such as the organizational level at which a role is performed and the ‘climate' 
[quotation mark in original] of the organization (p. 9). 

He proposes that factors related to information need and information-seeking behavior should be broad enough 
to include aspects of environments within which the work-role is performed, including not only the immediate 
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work environment but also the socio-cultural environment. Apparently, he emphasizes the importance of social 
context of IPS process in determining users’ information behavior. 

Social Informatics 

Social informatics is an area or approach of research that captures design, use and implications of information 
and communication technologies based on broader social and cultural contexts. This approach is shared among 
a wide range of disciplines including sociology, anthropology, computer science, management, information 
systems, communication and US (Kling, et al., 1998). According to Kling, et al (1998), social informatics is 
defined as 

The interdisciplinary study of design, uses and consequences of information, and information and 
communication technologies, and their interactions with institutional and cultural contexts (p. 

1048). 

Research under this approach explicitly accounts for the behavior of users and their organizations in relation 
to their differences in social values, beliefs, and power in their relationships. 

Some recent works in IR may be categorized under social informatics research. For example, Karamuftuoglu 
(1998) developed a theoretical framework to capture collaborative IR interaction that involves shared efforts 
in IPS processes involving multiple users. He argues that "the fundamental theoretical issues of [IR] are the 
production and use (consumption) of knowledge” that involves interactive collaboration among users in a 
discourse community. He makes distinction between two functions of IR interaction. According to him, the 
function of transfer of public knowledge from documents to individual users (search paradigm) emphasizes 
ways of describing documents (documentation). On the other hand, the function of production of new 
knowledge (new documents, ideas, etc.) through interaction among multiple users through IR interaction 
emphasizes generation and evaluation of new ideas and knowledge by reading pertinent texts and 
communicating with other people. He proposes to see IR systems as human communication mediated by 
computer networks (e g., Usenet Newsgroup, listserv, Internet Relay Chat, etc.) that facilitate the production 
and consumption of knowledge. 

Cool (1997), on the other hand, proposes a model that captures the IR interaction as social interaction. She 
makes distinctions among three goals of IR interaction: "(1) task, (2) topically oriented, and (3) those which 
are centered around situational assessment” (p. 135). Using the social interaction theory ; she identified four 
dimensions of situational assessment including (1) self-performance, (2) norms of interaction, (3) 
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communication conventions, and (4) intersubjectivity. Based on the content analysis of verbal protocol obtained 
from 50 IR sessions performed by different expert searchers using a new 1R system, she proposes that situational 
assessment is an important cognitive activity in new IR environments. 

Three user- value approaches and the behavioral approach of the Sheffield School described above may be 
considered to be categorized within a larger framework of social informatics. In other words, those research 
approaches categorized in this study as the social approach may in fact be labeled as social informatics in LIS. 

IMPLICATIONS OF SOCIAL APPROACH FOR THE STUDY 

No empirical research examined using the social approach explicitly addresses users’ perceptions underlining 
the human intermediation. But Nicholus's (1995, 199© study of British journalists and politicians, following a 
user-centered behavioral approach , discloses some empirical evidence on this phenomenon. He found, as by- 
products of his study of practitioner users’ self-searching, that a majority of British politicians’ research assistants 
preferred self-searching for more control and flexibility, while only a small number of them delegate the search 
to the professional intermediaries. The research assistants delegate because (1) they perceive professional 
intermediaries to be experienced, helpful and able to do the search more quickly, (2) they could not find what 
they wanted through self- searching, and (3) there was a long queue at the terminal. These research assistants 
would handle the easier searches and ask the library staff to do the more difficult ones. Also, the research 
assistants prefer to conduct self-searching for politically slanted information while making search requests of 
librarians for neutral or factual information. On the other hand, self-searchers are minorities among Guardian 
newspaper journalists. However, most of them do generate both self-searching and human intermediation 
depending upon the situation. Their reasons for self-searching are: (1) inability to explain their information 
needs because they don’t know what they are looking for, and (2) confidentiality concerns. Their reasons for 
delegation are: (1) proficiency of library staff, (2) difficulty of searching, (3) problems encountered in getting 
access, and (4) lack of time. Based on these findings, Nicholas 0995) concludes that self-searching and human 
intermediation are not mutually exclusive and the same user conducts self-searching sometimes but uses human 
intermediaries on other occasions. These findings suggest the adequacy of social approaches in addressing 
the research questions of this study. 

APPROACH TO THIS STUDY 

This study focuses on the use of human intermediation as seen by the user who generates them. More precisely, 
this research is inquiring into (1) tasks users request of intermediaries, and (2) situational factors possibly 
associated with the use of human intermediation as seen from users. The study further inquires into (3) patterns 
between users’ internal and external situations and tasks they request of human intermediaries. 

Different from existing studies, this study intends to view the phenomenon of human intermediation from 
users’ perspectives, tries to make distinction among different types of tasks requested by users of human 
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intermediaries, and attempts to capture the user’s external (social and environmental) situations as well as 
internal (cognitive and affective) states to explain why and how users decide to make use of human 
intermediation. The study assumes that IPS is a process and that the use of human intermediation is a particular 
activity initiated by the user and is encompassed within the IPS process. 

This research uniquely defines IR systems to include not only bibliographic databases, as in the case of most 
of the existing studies of human mediated IR interaction, but also non-bibliographic ones that include fulltext, 
numeric, and graphic data. By defining the scope of IR systems broadly, this research is expected to reflect 
increasing availability of a variety of electronic sources including those of the Internet. 

Because this research is unique in the above aspects, findings on the phenomenon of human intermediation 
as reviewed in the previous section may not directly apply by themselves. Thus, this research should be seen 
as an initial attempt to inquire into yet-to-be-investigated areas of IR and IPS research rather than a mere 
extension of human intermediation seen from professional intermediaries. 

These considerations suggested this research take an exploratory approach. At the same time, however, it 
should be advantageous to make the most out of what already was known about human intermediation 
through the literature in order to pay respect to the cumulative nature of scientific research. Thus, this research 
is built on models and findings borrowed from existing research of IR interaction and IPS from different 
perspectives as guideposts to lead the design and data analysis. Accordingly, this research used findings and 
models of existing studies in developing taxonomies to be used as a preliminary framework. 

Following sections will describe how this research utilized existing models and findings as initial tools to guide 
inquiry into the three research questions of this study. 

MODELS AND FINDINGS GUIDED RESEARCH 

QUESTION #1: TASKS REQUESTED OF HUMAN INTERMEDIATION 

The first research question asked in this study is: 

Ql: What kind of tasks do users request of human intermediaries? 

According to Allen (199 6), information retrieval tasks can be defined on multiple levels. One level of tasks is 
external tasks "accomplished by users as they attempt to meet their information needs” (p. 29). The external 
tasks are general and device-independent. They are goals of an IR interaction and subgoals of IPS process. 
Another level of tasks proposed by Allen (1996) is internal tasks "accomplished while using information devices” 
(p. 30). They are device-dependent and, therefore, affected by the limitation of existing devices such as a 
particular IR system. For example, "query formulation" is an external task that may includes a variety of internal 
tasks such as selection of terms, definition of relationships among selected concepts and/or terms, and 
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development of search statements. These internal tasks differ depending upon 1R systems and databases to 
be used. If a bibliographic IR system (e.g., DIALOG) is used and a database with a highly structured thesaurus 
(e.g., ERIC) is selected, the selection of terms may include browsing of the thesaurus. The definition of 
relationships among selected concepts may involve the use of Boolean operators. The development of search 
statements may involve the employment of DIALOG’S command languages. These internal tasks, however, 
should be quite different if the searcher uses a fulltext system (e.g., LexisNexis) with a newspaper database 
without controlled vocabulary. Allen 099 6) emphasizes the importance of carefully distinguishing these two 
levels and proposes to consider internal tasks to be subordinated to external tasks in order to facilitate innovative 
system design. This research may involve a variety of IR systems and databases as selected by users or 
intermediaries. Thus, the level of analysis of tasks should be external so as to eliminate the effects of different 
IR systems and databases. 

Allen (199 6) refers to Kuhlthau’s (1985; 1992) six-step model of information search process (ISP) as one of the 
most elaborated external task models of IPS process. As examined earlier, Kuhlthau’s JSP Process Model is very 
similar to Eisenberg and Berkowitz’s (1995) Big 6 Model (Appendix B1 (1)) that was used as a guide to lead 
this study. The reason for this research to rely on the Big 6 Model , rather than Kuhlthau’s ISP model, is its 
potential applicability to a wider variety of IPS tasks not limited to educational purposes. Thus, the Big 6 Model 
has the potential to take into account the social aspects of IPS behavior typically operating in IPS processes 
for informational purposes (White, 1992), the emphasis of this study. Allen (1996) also refers to Marchionini’s 
(1995) five-step process of user searching of fulltext or bibliographic databases as a model of external tasks. 
They are: (1) defining the problem, (2) selecting the source, (3) articulating the problem, (4) examining the 
results, and (5) extracting the information. Fidel and SoegePs (1983) model of tasks performed by professional 
intermediaries in searching of bibliographic databases, as described in the previous section, may also be 
considered as a model of external tasks. 

Table 3-3 compares and contrasts three models of external tasks of IPS and IR processes. Even though some 
of the tasks in Big 6 Model do not have equivalent tasks in either Marchionini’s or Fidel and Soagel’s, the first 
four steps of the Big 6 Model correspond well to the other two models. However, the last two stages of the 
Big 6 Model do not find corresponding tasks in either of the other two models. This inconsistency in the three 
models is at least partially due to the ambiguity of post-logoff activities as well as of the limitation to 
bibliographic databases used in Fidel 8c Soagel’s (1983) model as addressed in the previous section. Thus, the 
Big 6 Model (Appendix B1 (1)) was chosen as the initial framework to analyze tasks requested of intermediaries 
as the tool to guide the data-collection and analysis in answering the first research question RQ1. 
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Table 3-3: Comparison of Three Models of External Tasks in IPS and IR Process 



Big 6 Model 
(General IPS tasks) 


Marchionini’s (1 992) Model 
(User tasks in IR interaction) 


Fidel & Soagel's (1 983) Model (Tasks of 
intermediaries in bibliographic IR 
interaction) 


1. Task Definition 


Defining the problem 
3. Articulating the problem 




2. Information Seeking Strategies 




1. Query formulation 


3. Location and Access 


2. Selecting the source 

3. Articulating the problem 


Selection of search system(s) and 
database® 

Interaction with the search system(s) and 
database(s) 

Termination of the search and final set 


4. Use of Information 


4. Examining the results 

5. Extracting the information 


5. Post-logoff activities 


5. Synthesis 




6. Evaluation 





* Numbers used in this table reflect the original categories of respective models. 



MODELS AND FINDINGS GUIDING RESEARCH 
QUESTION #2: FACTORS ASSOCIATED WITH 
THE USE OF HUMAN INTERMEDIATION 

This section provides a preliminary framework based on empirical findings and models in relation to the 
second research question being inquired into in this research: 

Q2: What situational factors do users perceive to be salient when they make requests of human 
intermediaries ? 



This research assumes both internal and external factors operate in users’ selection of IPS behavior in general 
and the use of human intermediation in particular. This assumption fits well with the triadic reciprocity of 
person, environment and behavior as proposed by Bandura (1986) and presented in his social cognitive theory . 



4 Even though the theory is generally referred to as "social learning theory," this study uses the term "social cognitive theory" to accept Bandura’s (1986) claim that the 
theory not only covers descriptive but also "motivational and selhregulatory mechanisms. . .that extend beyond issues of learning" (p. xii). 
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According to Bandura (1986), in the model of reciprocal determinism : 

...behavior, cognitive and other personal factors, and environmental influences all operate 
interactively as determinants of each other. . . The term determinism is used here to signify the 
production of effects by certain factors, rather than in the doctrinal sense of action being completely 
determined by a prior sequence of causes operating independently of the individual. Many factors 
are often needed to create a given effect. Because of the multiplicity of interacting influences, the 
same factor can be a part of different blends of conditions that have different effects (p. 23-24). 

IR and IPS researchers who take user-centered perspectives have long assumed IR and IPS are goal-directed 
behavior (Bates, 1979a; Borgman, 1996; Fidel, 1991; Heit, 1997; Katzer, 1987; Kuhlthau, et al., 1992; O’Day & 
Jeffries, 1993b; Rouse & Rouse, 1984; Saracevic, et al., 1988; Spink, 1977b; Taylor, 1986; Xie, 1998). 

Bandura’s social cognitive theory defines goals as cognitively represented future events that motivate present 
human behavior: 

In cognitively generated motivation, people motivate themselves and guide their actions 
anticipatorily through the exercise of forethought. They anticipate likely outcomes of prospective 
actions, they set goals for themselves, and they plan courses of action designed to realize valued 
futures (Bandura, 1989, p. 19). 

According to Bandura (1986), social cognitive theory incorporates multiple levels of goals and explains how 
higher-level goals of general principles control lower-level goals of context-specific plans. He says: 

Social cognitive theory distinguishes between distal goals and proximal subgoals. End [distal] 
goals serve as general directive function, but specific subgoals determine people’s immediate 
choice Of activities and how hard they will work on them (Bandura, 1986, p. 473-474). 

This notion of multiple levels of goals see ms to be useful in connecting the gap between IR and IPS research. 
User goals of using IR interaction may be considered as proximal sub-goals of users’ IPS processes. A user 
may engage in an IPS process with a specific goal (e.g., conduct research, write a paper, do a reading assignment 
for a class, make a decision) in mind. The user chose to use human intermediation at some point in the IPS 
process with specific goals (e.g., decide the topic, find relevant documents useful for literature review, verify 
own knowledge or search process/result) in mind which is a proximal sub-goal of the IPS goal. The IPS goal 
may be a proximal sub-goal of distal goals that are on a higher level. 
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Another assumption of this study is the situationality of human information behavior. Suchman (1987) advocates 
a view of situated action as the basis of purposeful human communication behavior. She proposes that all 
kinds of goal-directed human communication behavior, including interactive computing, consists of a set of 
interaction in which the actual action is contingent on a particular situation, and thus is essentially ad hoc. 
Thus, she insists, studies of user behavior as well as system design of interactive machines should make 
situationality the central focus. Situationality of IR interaction is also emphasized by many researchers of IR 
and IPS (O’Day & Jeffries, 1993a, 1993b; Hert, 1995; Spink, 1997a). 

Thus, this research categorizes potential factors by using two axes of personal vs. social & environmental 
aspects and of situational (dynamic) vs. static aspects as shown in Appendix B2 (1). I assumed that there might 
be an unlimited number of potential factors possibly associated with users’ decision to use human 
intermediation. However, it was not possible or realistic to include all potential factors in the taxonomy. Thus, 
only those factors that were explicitly mentioned by the literature on IR and IPS and reviewed in the previous 
chapter were included in Appendix B2 (1). Other factors, if important, should have been elicited during the 
data collection and analysis phase of the study. The taxonomy was used as the tool to guide the data-collection 
and analysis in answering the second research question RQ2. 

CHAPTER CONCLUSION 

The intention of this chapter was to review the approaches in IR and IPS research considered relevant for the 
study. The aims of the literature review in this chapter were: 

• To support the choice of the user-centered research perspective, 

• To justify the choice of the approach appropriate for the research questions from among potential 
user-centered approaches, 

• To identify frameworks that should be useful as a preliminary guide for research design and data 
collection. 



The result was synthesized as follows: 

1. The social approach was chosen, because this user-based approach emphasizes the social and 
environmental impacts on human IPS behavior in addition to internal (cognitive and affective) 
aspects, which is adequate for the study context. 

2. A preliminary framework was identified for each of the two major research questions. A taxonomy 
of potential tasks requested of human intermediaries was chosen for guiding the first research 
question RQ1, and a taxonomy of potential factors associated with the use of human intermediation 
was developed for guiding the second research question RQ2. 





CHAPTER 

FOUR 



METHODOLOGY 
OF THE 

EMPIRICAL STUDY 



This chapter describes the research design and procedures used in this study. The key methodological issues 
to be addressed are: 



• Assumptions underlying the research design; 

• Methodological challenges; 

• Research design; 

• Data collection and analysis techniques; and 

• Methodological limitations. 



ASSUMPTIONS UNDERLYING THE RESEARCH DESIGN 

The following assumptions were developed in order to establish bases for the research approach and design. 

TASKS REQUESTED OF INTERMEDIARIES 

The first research question ( what kinds of tasks do users request of human intermediaries ?) is intended to 
identify and categorize information problem solving (IPS) tasks requested by users of human intermediaries. 
Because this research took a users' perspective, the requests made by users, rather than tasks actually performed 
by the intermediaries, should be examined as the source of tasks to be elicited and categorized. These tasks 
should be elicited from (1) users' request messages sent to the digital reference service (DRS) and (2) users' 
articulation of their requests through an interview. 
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FACTORS ASSOCIATED WITH THE USE OF HUMAN INTERMEDIATION 

The second research question ( what situational factors do users perceive to be salient when they make requests 
of human intermediaries P) is intended to capture the dynamically changing situational factors associated with 
users’ initiation of the use of human intermediation. The study assumed that some of the dynamic factors 
might not have been identified in the literature. This was because most of the existing research tends to 
concentrate on users’ internal (cognitive and/or affective) factors without taking into consideration a full 
spectrum of external (social and environmental) factors possibly operating in the use of human intermediation. 
Therefore, the methodology should explicitly try to capture yet to be identified social and environmental 
situations of users. 



IPS PROCESSES AS DYNAMIC SITUATIONS 

This research assumed that the use of human intermediation is a particular activity encompassed in the user’s 
IPS process. This assumption suggested that this research should view the process of an IPS as structured by 
dynamically changing situations. In other words, users make decisions on their action (i.e., of the use of human 
intermediation) consciously or unconsciously, based on what happened and what is going on while they make 
use of human intermediation as well as on what they anticipate happening during and after the intermediation. 
Thus, the study should try to capture as much as possible the entire process of an IPS, while the focus of the 
study was the moment at which the user made a request of human intermediaries. 

METHODOLOGICAL CHALLENGES 

This research has two major methodological challenges. One is to capture users’ naturally occurring IPS 
processes from the users’ perspective in order to identify tasks requested of intermediaries and situational 
factors, rather than to confirm the effects of already identified variables. The other is to observe both internal 
and external situations of users in relation to their use of human intermediation. The following sections articulate 
these challenges as well as how this research addressed them. 

CAPTURING NATURALLY OCCURRING HUMAN INTERMEDIATION 

Most of the variables used in this study have not yet been fully explored empirically. For example, even though 
IPS tasks being performed by users in self-searching have been studied (Kuhlthau, 1992; Marchionini, 1989), 
they have not been examined empirically as tasks requested of human intermediaries. Situational factors found 
by empirical research as associated with users’ IPS behavior were limited to users’ internal (cognitive and/or 
affective) states, rather than external (social and environmental) contexts. Moreover, users’ IPS processes 
themselves have only been examined within limited educational contexts using students as respondents. 

This research was designed as an exploratory study so as to capture yet-to-be identified categories, factors 
and IPS processes. In other words, this study intended to (1) gain insights into characteristics of tasks requested 
by users of human intermediaries, (2) identify not only internal (cognitive and/or affective) but also external 
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(social and/or environmental) factors that might be associated with users’ decision to use human intermediaries, 
and (3) examine possible associations between tasks requested of human intermediaries and situational factors 
within users’ IPS processes. 

Even though this study utilized models and findings of existing research as guiding tools, it could not use an 
experimental or quasi-experimental research design. This is because the major purpose of the study was to 
expand these findings and models by identifying new variables and hypotheses rather than to test existing 
hypotheses drawn from these models and findings. Artificially developed information problems or other 
externally imposed experimental conditions might impact significantly on the internal (cognitive and/or 
affective) and external (social and/or environmental) situations of users. Thus, the study took a naturalistic 
approach so as to capture naturally occurring human IPS processes that include human intermediation, based 
on users’ perspective, while minimizing as much as possible introduction of distortions into the processes. 

LIMITATION IN ELICITING SITUATIONAL FACTORS 

This study needed to identify (1) what stimuli or factors users perceive to be important at the moment when 
they decide to use human intermediaries and (2) how users make the association between stimuli and their 
decision. Thus, the methodology should be able to elicit not only the stimuli that users perceive to be important 
in relation to such decisions but also the higher-level cognitive process of reasoning - what associations users 
make between the stimuli and the decision to use human intermediation. 

Users are likely to have made decisions to use particular type of human intermediation, consciously or 
unconsciously, prior to their action of making requests. However, it is not possible to predict when such a 
decision will be made, or when the users perceive the stimuli that generate the decision. Thus, it is impossible 
for the researcher to plan to be present when the user makes such decisions. Moreover, it is impossible for 
the researcher to directly observe the decision-making process of the users, because the internal process of 
the user, or what is going on in the user’s mind, is not directly observable by the researcher anyway. Thus, 
the research inevitably relies on users’ self-reporting of their perception of the stimuli and their higher-order 
reasoning processes, at a later time, after such decisions have already been made. 

Self-reporting of internal processes is known to have several drawbacks: 

• People tend to reconstruct the processes to legitimize their behavior as rational (Ericsson & Simon, 1984), 

• People’s attention is selective - many stimuli are processed unconsciously and only those perceived to 
be important are retained in the memory of the reporter (Petty & Cacioppo, 198 6), 

• People have difficulty articulating how they "do things in general" (Simon & Burstein, 1983), 

• People may not report self-negative stimuli to a stranger even when they are important (Bates, et al., 
1995). 
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Nevertheless, this study unavoidably relied on the self-reporting of users, because the tradition of behavioral 
science has not yet developed the strong methodology necessary to overcome these drawbacks. 

According to Nisbett and Wilson (1977), self-reporting of internal process is more reliable when: 

• The time interval between the occurrence of the process and the reporting is minimal, 

• The magnitude of the stimuli (causes) and behavior (effects) are in balance, 

• The culture or the subculture of the reporter legitimizes the association between the stimuli and 
the behavior, 

• The candidate stimuli are few in number, and 

• Stimuli are perceptually or memorially salient to the reporter. 



Thus the study tried to minimize the drawbacks and to keep users' self-reporting as reliable as possible by 
paying conscious attention to the above key points by: 

(1) Collecting real-life experience to minimize possible memory loss, 

(2) Encouraging participants to speak about what they actually thought, felt and did, rather than what 
they think they should have thought, felt and done, and 

(3) Asking participants their perceived importance of the incident as well as their evaluation of and 
satisfaction with the outcome in order to make sure the incident was memorially salient. 

Regardless of the compromise due to the limitations of existing methodology, the approach taken by this study 
is still exploratory. Marshall and Rossmann (1994) defined the purpose of an "exploratory" approach as: 

... to investigate little-understood phenomena, to identify/discover important variables, and 
to generate hypotheses for future research (p. 41). 

The study used existing models and findings based on the intermediaries’ perspective of human intermediation, 
but it still investigated little-understood phenomena of the uses of human intermediation as seen from users’ 
perspective, tried to discover important variables and associations among them, and to generate new hypotheses 
for future study. 

The study's design is naturalistic. Patton (1990) defined the "naturalistic inquiry" as: 
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... studying real world situations as they unfold naturally, non-manipulative, unobtrusive, 
and non-controlling; openness to whatever emerges - lack of predetermined constraints on 
outcomes (p. 40). 

This study collected data of participants’ self-reporting at a later time, and therefore, might include reconstruction 
of situations made by study participants. However, it still tried to capture naturally occurring real world situations 
in the least obtrusive way without manipulation and controlling. 

OVERVIEW OF RESEARCH DESIGN 

The study consisted of three research phases. Figure 4-1 describes these phases at the conceptual level, while 
Table 4-1 synthesizes the major research activities performed in the study. All details are explained in later 
sections. 



RESEARCH DESIGN PHASE 1 

This section presents an overview of phase 1 of the research procedure. 

Literature Review 

The purpose of the literature review, in terms of the research process, is to uncover the conscious and 
unconscious assumptions underlying the problem of the study and to prepare the investigator as a master of 
the theories and Findings relevant to the phenomena of the study (McCracken, 1988). My experiential knowledge 
guided to locate and examine appropriate literature for the purpose of the study, while the activity of reviewing 
literature and observation of users enhanced and modified structure of domain knowledge. 

Development of the Preliminary Conceptual Model 

The review of relevant literature, helped by the expanded experiential knowledge, derived research questions 
and the initial framework (conceptual model) of the study to be the basis for its data collection and analysis. 
Specifically, the Big 6 Model (Appendix B1 (1)) was identified as the initial framework for analyzing and 
categorizing tasks requested of intermediaries, while the Taxonomy of Potential Factors Associated with the 
Use of Human Intermediation (Appendix B2 (1)) was developed as the initial framework for analyzing and 
categorizing situational factors possibly associated with the use of human intermediation. 

Design of Data Collection Instruments and Procedure 

The initial framework was incorporated into the design of data collection instruments and used to help develop 
the procedure of data collection and analysis. The procedure and instruments were tested with a small sample 1 
and revised. 



1 The interview procedure and instruments were tested through face-to-face interviews with two medical researchers, two SU faculty members, two business practitioners, 
and four doctoral students. They were revised and tested through telephone interviews with two retired K-1 2 teachers. 
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Selection of Study Settings 

The unit of analysis of this study was a request that represented a use of human intermediation encompassed 
within a naturally occurring information problem solving (IPS) process as seen from the point of view of a 
user. Thus, study data should be collected from users of human intermediaries. 1 developed five criteria for 
the selection of the user population: (1) they have access to the human intermediaries, (2) they have access 
to the Internet, (3) they represent a wide variety of settings; (4) they represent an adult population; and (5) 
they are approachable from the study. 



Figure 4-1 : Research Design 
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Table 4-1: Major Activities Performed in Each Phase of the Research 



Phase 


MajorAcMy 


Description 


Phase 1 


Literature review 


Synthesis of assumptions underlying the problem of the study 




Development of the preliminary 
conceptual model 


Identification of potential taxonomies of (1) tasks requested of 
intermediaries and (2) situational factors possibly associated with the 
use of human intermediation 




Design and pretest of data collection 


Design and pretest of interview schedule and interview guides 




instruments and procedure 


Selection of study settings 






Pre-test the procedure of developing and refining taxonomies of 
tasks requested of intermediaries by examination of a small 
sample of request messages 


Phase 2 


Data collection: systematic sampling of 


Collection of past requests of online question/answering services 


Step 1 


past requests 

Data analysis: content analysis of past 
requests 


Development and refinement of the taxonomy of tasks requested of 
intermediaries based on content analysis of a sample of past requests 


Step 2 


Data collection: telephone interview 


Collection of situational factors and tasks requested of intermediaries 




Data analysis: modified constant 
comparison 


Development and refinement of the taxonomy of situational factors 
associated with the use of online question/answering services; 
Refinement of taxonomy of tasks requested of intermediaries 


Step 3 


Data analysis: modified constant 
comparison 


Identification of associations among situational factors and tasks 
requested of intermediaries 


Phase 3 


Modification of conceptual model 


Revision and enhancement the conceptual model 




Reporting 


Interpretation and writing of research findings 



The first criterion was the baseline of the required conditions of users. If a person does not have any access 
to the human intermediaries, s/he would hardly generate the use of human intermediation. The second criterion 
was important for the purpose of the study that sought to identify why and in what situations people use 
human intermediaries rather than using IR systems by themselves. In this study, the Internet was used as the 
instantiation of IR systems because users of the Internet have ready access to most of the search engines (IR 
systems) and web sites (databases) without attending training sessions or obtaining passwords. Thus, there 
should be reasons other than accessibility of the Internet for users to make use of human intermediation. The 
third criterion, the requirement for the inclusion of a variety of settings was desirable in order to make findings 
of this study more transferable to diverse settings. The fourth criterion, adult population, was to avoid the 
unnecessary complexities involved in using minors as participants. Though I assumed that the internal and 
external situations of children might be quite different from those of adults, it was not feasible within the scope 
of this study. This is because the inclusion of minors in the study should necessarily involve their parents for 
ethical reasons. The fifth criterion, approachability, was important because the study needs to capture each 
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user's behavior of using human intermediation and associated situational factors seen from the user as part of 
her/his naturally occurring IPS processes. Thus the researcher should be able to understand the user’s self- 
reporting of the request and associated situations. 

The AskERIC Online Question-Answering Service (AskERIC Q&A Service) was selected as the site to recruit 
participants of the study, because its clients are representative of users of human intermediation and fulfill 
most of the above criteria. They have access to human intermediaries (i.e., AskERIC support staff) and the 
evidence of their use of human intermediation (i.e., AskERIC Q&A Service) is readily available as request 
messages. They have direct access to the Internet because they send requests using AskERIC Website or e- 
mail. A recent survey of AskERIC clients found that they represent diverse settings 2 . Since the AskERIC service 
is focused on educators, most of its clients should represent an adult population. I was familiar with AskERIC 
clients through my experience in conducting an online survey in the Gateway to Educational Materials (GEM) 
Project 3 as a research assistant. On the other hand, the study could not observe users directly nor could face- 
to-face interviews be arranged due to the fact that most of AskERIC clients live and work a great distance from 
the research site. 

Pretest of Data Collection and Analysis Process 

A sample of 100 past requests made by AskERIC clients was analyzed using a content-analysis technique in 
order to verify the usefulness of the initial framework in categorizing tasks requested of intermediaries. Due 
to the limitation of the Big 6 Model in categorizing some of the request messages, it was modified. An interview 
schedule and an interview guide for pre-test were designed based on the revised taxonomy of tasks requested 
of intermediaries (Appendix B1 (2)) and the initial framework of situational factors (Appendix B2 (1)) 

Pretest telephone interviews were conducted during July and August 1998 with 15 AskERIC clients who agreed 
to participate. The telephone interview was tape-recorded and transcribed. Situational factors presumably 
associated with clients' use of AskERIC were elicited using a modified constant comparative technique. The 
interview guide was revised several times during the pretest in the following aspects: 

• Changes were made in the order of some questions so that I could understand participants' situations 
more easily. 

• Some questions were added in order to avoid misunderstanding. 

• Changes were made in the structure of some of the questions (e.g., tasks requested of AskERIC) in 
order for the participants to easily understand the question. 



7 Informal Marketing Survey for AskERIC, sent out between February 23rd and March 16th in 1998 with 28.4% response rate, found that its clients represent a wide 
variety of settings including K-1 2 teachers (29%), students (16%), faculty (10%), administrators (11%), librarians (10%), and parents (6%). 

3 A consortium effort that provides educators with quick and easy access to collections of educational materials found on various federal, state, university, no-profit, and 
commercial Internet sites, sponsored by the U.S. Department of Education (www.thegateway.org). 
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The interview procedure of the study was also modified after the pretest in the following aspects: 

• Systematic sampling technique (every Nth request) was replaced by theoretical sampling to obtain 
a maximum variability within the context of the study setting. 

• The timing of sending the initial recruitment message was changed from the day AskERIC received 
the request to three business days after so that the recruitment message would be sent to the potential 
participant right after s/he received a response from AskERIC. Since AskERIC usually responds to 
its clients within two business days after receiving requests, this condition was desirable to prevent 
the Hawthorn effect up to the point at which the participant receives an answer or information from 
AskERIC. 

RESEARCH DESIGN PHASE 2 

This section presents an overview of the phase 2 of the research procedure. Data collection and analysis 
techniques mentioned in this section will be fully described in a later section. 

Development of the Taxonomy of Tasks Requested of Human Intermediaries 

A sample of 500 past requests made by clients of AskERIC was analyzed in order to refine the revised taxonomy 
of tasks requested of intermediaries. Data elicited from a sample of past requests were content-analyzed. The 
refined taxonomy (Appendix B1 (3)) was incorporated into the theoretical sampling of study participants and 
the design of the interview schedule and interview guide used to collect study data from AskERIC clients. 

The refined taxonomy (Appendix B1 (3)) was intended to be applied to categorize request messages of study 
participants. However, due to considerable discrepancies between what the original request message implied 
and what the participant said s/he requested later in the interview, the taxonomy was further refined by 
categorizing tasks requested based on the interview data. The final taxonomy (Table 5-1) was then applied 
to the request messages and interview data of the study participants to identify plausible sources of 
inconsistencies between request messages and interview data. 

Development of the Taxonomy of Situational Factors 
Associated with the Use of Human Intermediation 

I conducted telephone interviews with AskERIC clients in order to collect data about tasks participants requested 
and situational factors associated with their use of human intermediation (i.e., the AskERIC Q&A Service). 
During the interview, 1 elicited the task requested of the AskERIC Q&A Service and internal and external 
situations of each participant's IPS process. The interviews were audio-recorded and transcribed. The transcribed 
interviews were content-analyzed to identify tasks requested and associated situational factors. These tasks 
and factors were examined to refine the taxonomy of potential factors associated with the use of human 
intermediaries (Appendix B2 (3)) using a top-down strategy of modified constant comparative technique. 
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Examination of Association between Tasks and Factors 

I examined the patterns between tasks requested of intermediaries and situational factors in order to discover 
possible associations between them. Based on the results of the analysis, working hypotheses were developed 
concerning the associations observed between tasks requested of intermediaries and situational factors as well 
as among situational factors. 

RESEARCH DESIGN PHASE 3 

The study’s findings were compared with each 
examined. Refined hypotheses were synthesized 
fully described in a later section. 

TIMELINE OF THE STUDY 

Table 4-2 presents the timeline for the conduct of the study. 



other, and working hypotheses between categories were 
into a conceptual model. The data analysis process will be 



Table 4-2: Timeline of the Study 



Tasks 

Schedule 


Refinement of the 
Taxonomy of Tasks 
Requested of 
Intermediaries 


Refinement of the 
Taxonomy of Situational 
Factors 


Examination of 
Association Between 
Tasks and Factors 


Milestones & Activities 


April 1997- 
August, 1998 


Identification of the initial 
Taxonomy of IPS Tasks. 

Content analysis of past 
requests & revision of the 
taxonomy. 


Development of the 
Taxonomy of Potential 
Factors Associated with the 
Use of Intermediaries. 

Development of data 
collection instruments. 




Finalize the data 
collection instruments 
(interview guide) 

Pretest the data 
collection and analysis 
procedure 


November 1998 


Content analysis of a 
sample of 500 past 
requests. 


December 1 998 - 
August 1999 


Telephone interview & 
content analysis of 
interview data. 


Telephone interviews, 
content analysis of 
telephone interview data. 


Data analysis 


Finalize the Taxonomy 
of Tasks Requested of 
Intermediaries. 

Finalize the Situational 
Factors 


September 1999- 
October 1999 








Comparison of tasks 
requested and 
situational factors. 


November 1999 








Revise & enhance 
conceptual model. 


December 1999- 
February 2000 








Draft of dissertation. 



8.9 00 
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DATA COLLECTION AND ANALYSIS TECHNIQUES 

This study was planned to collect data from two sources. Tasks requested of intermediaries were planned to 
be elicited from request messages sent to AskERIC by study participants. Situational factors and demographic 
information were elicited from study participants by telephone interviews. However, I recognized during 
telephone interview, that there were considerable discrepancies between what the original request message 
implied and what the participant said s/he intended to request, in terms of tasks requested of human 
intermediaries. Therefore, the initial strategy was modified and data analysis was focused on the interview 
data for both (1) tasks requested of intermediaries, and (2) situational factors associated with the use of human 
intermediation. I analyzed these data using content analysis techniques employing a top-down strategy of a 
modified constant comparative technique 4 . The following sections describe data collection and analysis 
techniques employed in the study. 

DEVELOPMENT OF THE TAXONOMY OF TASKS 
REQUESTED OF INTERMEDIARIES (STEP 1) 

The goal of developing and refining the taxonomy of tasks requested of human intermediaries was to use it 
for the theoretical sampling of potential participants of the study in step 2. 

Sampling of Past Requests 

A sample of 500 past requests received during April 1998 was drawn from the archive of AskERIC using a 
systematic sampling technique (e.g., every 10* stratified by site and date). These requests were a naturalistic 
sample because they were generated during clients’ naturally occurred IPS processes without any intervention 
by the research. They seemed adequate for eliciting a wide variety of tasks requested of the AskERIC Q&A 
Service by the clients. 

Data Analysis Technique - Top-Down Strategy of Content Analysis 

Content analysis technique was used to elicit tasks requested of intermediaries reflected in the sample of past 
clients’ requests. Content analysis is a technique that seeks to find patterns and meanings in a variety of data 
unobtrusively (Krippendorff, 1980; Manning & Cullum-Swan, 1994). In this study, the initial data coding used 
a deductive (top-down) strategy by employing the Taxonomy of Tasks Requested of Intermediaries modified 
in pretest (Appendix B1 (2)) 5 as the coding scheme for eliciting and categorizing tasks requested of 
intermediaries from the sample. An inductive strategy was introduced in a situation where tasks requested of 
intermediaries were not adequately categorized using the initial coding scheme. 



4 The technique is also called as a modified analytic induction (e.g., Silverman, 1 993). 

5 Originally based on Big 6 iVfotfe/ (Eisenberg & Berkowitz, 1995) and modified with content analysis of the sample of a smaller number (100) of past AskERIC requests 
in the pretest. 
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I followed general guidelines provided by Krippendorff (1980) to refine the taxonomy. I read request messages, 
elicited the portions of messages representing tasks requested of intermediaries, and coded them using the 
revised coding scheme. When I could not categorize a task by using the revised coding scheme, I assigned 
"Dunk (meaning other)," while I assigned multiple codes to the request message if I could not categorize it 
with a single code. After the initial coding, I examined the coding results. I dropped codes from the scheme 
if they were not assigned to any of the requests. When 1 noticed that the "Dunk" was assigned to many similar 
items, I introduced a new code that represented a particular type of task not included in the initial scheme 
and added it to the taxonomy. After I came to the point at which no new categories could be added to the 
scheme, 1 formulated the intermediate scheme and associated coding rules. 

The scheme and coding rules were given to another analyst, and both the analyst and I coded the same subset 
of the messages (a randomly selected 10% of the sample request messages). The analyst and I jointly reviewed 
our coding decisions and confirmed that the scheme and rules were clear enough for any analyst to reach the 
same decision about coding for a request message. 

The intercoder agreement was tested in order to verify that coding agreement was due to the reliability of the 
coding scheme and not to random chance. Several statistics are available to verify the reliability or reproducibility 
of a coding scheme (Krippendorff, 1980). This study used Kappa (Cohen, I960), a statistic that represents a 
coefficient of inter- judge agreement for nominal scales 6 . A larger value of Kappa indicates higher inter-coder 
reliability. However, the adequate level of data reliability should be determined by the researcher based on 
the required level of validity imposed upon the study result, unless it is so low that the findings will be negligible 
(Krippendorff, 1980). 



Table 4-3: Inter-Coder Agreement In Developing and Refining the Taxonomy of Tasks Requested of Intermediaries 



Taxonomy Used 


Data Used to Refine the Taxonomy 


Data Used for Inter-Coder Reliability Check 


Coefficient of Reliability for 
Each Coder* 


A 


B 


C 


D 


3J 


Appendix B1 (2) 


100 request messages received 
by AskERIC in April 1 998. 


100 request messages received by 
AskERIC in April 1998. 


.69 


■ 


■ 


■ 


■ 


Appendix B1 (3) 


500 request messages received 
by AskERIC in April 1 998 


10% stratified sample of 500 request mes- 
sages received by AskERIC in April 1 998 


.72 


.68 


.62 


.60 


.45 


Final Taxonomy 
(Table 5-1) 


62 Participants’ request messages 


A stratified sample of 10 request mes- 
sages of 62 study participants. 


■ 




.72 


■ 


■ 


62 participants' interview data 


A stratified sample of 1 0 interview data of 
62 study participants 


■ 




.94 




■ 



* Coefficient of reliability between coding by myself and by five analysts A, B, C, D, and E. 



6 k = (Po-Pc)/(1 -Pc): where Po = the proportion of units in which the judges agree; and Pc = the proportion of units for which agreement is expected by chance 
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Table 4-3 describes inter-coder agreement in each step of developing and refining the taxonomy of tasks 
requested of intermediaries. 

In the pretest, a stratified (every 50*0 sample of 100 request messages received by AskERIC in April 1998 was 
content-analyzed using the Big 6 Model (Appendix B (1)) as the initial framework, and an interim version of 
the taxonomy (Appendix B (2)) was developed. The inter-coder reliability check was performed with one 
analyst (coder A) and resulting Kappa was .69. 

In the main study, a stratified (every 10 th ) sample of 300 request messages received by AskERIC in April 1998, 
but not used for pre-test, was content-analyzed using the interim taxonomy (Appendix B1 (2)) as the initial 
framework, and the third version of the taxonomy (Appendix B1 (3)) was developed. The inter-coder reliability 
check was performed with five analysts (coders A, B, C, D, and E), and resulting Kappa were .70, .68, .62, 
.60, and .43 respectively. This taxonomy (Appendix B1 (3)) was used as the basis for theoretical sampling of 
potential participants of telephone interviews and incorporated into the design of the interview guide (Appendix 
A4). 

The third version of the taxonomy (Appendix B1 (3)) was further refined by content analysis of request 
messages and interview data of 62 study participants, and the final taxonomy (Table 3-1) was developed. 
Inter-coder reliability check was performed separately for request messages and interview data using the final 
taxonomy with one analyst (coder C), and resulting Kappa was .72 and .94 respectively. 

Recruitment Procedure 

Recruitment and telephone interviews of participants were performed in four waves. Table 4-4 presents the 
schedule of recruitment and interviews processes for each wave. The sequence of e-mail exchange between 
the research, AskERIC, and clients (potential participants) are described in Figure 4-2. 



Table 4-4: Schedule of Recruitment and Interview of Participants 



Waves 


Reception of 
Requests 


Recruitment 
Message Sent-out 


Reminder of Recruitment 
Message Sent-out 


interview Period 


Number of Interviews 
Performed 


Wave 1 


12/7/98 


12/10/98 


12/14/98 


12/13-21/98 


15 


Wave 2 


1/11/99 


1/14/99 


1/18/99 


1/18-25/99 


18 


Wave 3 


1/25/99 


1/28/99 


2/1/99 


2/1-8/99 


15 


Wave 4 


2/8/99 


2/11/99 


2/15/99 


2/15-22/99 


17 


Total 










65 
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Figure 4-2: Sequence of Telephone Interview Process 




For each wave, the recruitment messages were forwarded through e-mail to a sample of AskERIC clients three 
business days after AskERIC received their request using theoretical sampling technique 7 . The main reason for 
using the theoretical sampling technique was that the samples for naturalistic studies are not dependent upon 
statistical representation but on how well the sample answers research questions (CresweU, 1994). Since the 
third research question sought to discover associations between tasks requested of intermediaries and the 
situations of users, it was important to obtain a maximum variability of tasks so that a balanced number of 
participants were recruited for each task type. 

The recruitment message was accompanied by two forms: (1) agreement form to be filled in by those who 
were willing to participate, and (2) reason for not participating form to be filled in by non-participants. Only 
those clients who were over 18 years old and lived in the United States were invited to participate. Those who 
agreed to participate in the study filled in the agreement form with their name, telephone number, two 
convenient time slots for the telephone interview, and state in which they live/work. Those who could not 
or didn’t want to participate filled in the reason for not participating form with their reason(s) for non- 
participation. Both of these clients were instructed to send the form back to my e-mail address within five 
days (see Appendix A1 for the actual recruitment message). 



7 A systematic sampling scheme (every Nth requests received) was used tor pretest, but resuited in over-representation of a particular type of request. 
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Table 4-5: Distribution of Task Codes Among Potential Participants (N=426) 



Waves 


A: Search- strategy 


B: Source-locating 


C: Fact-finding 


D: Opinion-giving 


Total 


Wave 1 


26 


48 


16 


38 


128 


Wave 2 


19 


31 


46 


29 


125 


Wave 3 


23 


18 


13 


22 


76 


Wave 4 


2 


9 


22 


64 


98 


Total 


70 


106 


97 


153 


426 



Potential participants were selected using a theoretical sampling technique based on the task code(s) assigned 
to the request message in order to obtain the maximum variation of tasks. The distribution of tasks requested 
of AskERIC based on the analysis of their request messages using the revised taxonomy of tasks requested of 
intermediaries (Appendix B1 (3)) is presented in Table 4-5. 



The recruitment message (Appendix Al) was forwarded by e-mail to a total of 426 participants. A reminder 
for the recruitment message { Appendix A2) was forwarded to them on the fifth day after the initial recruitment 
message in order to encourage participation in the study. Among them, 75 responded with the agreement 
form , while 89 responded with a reason for not participating form filled by reasons for non-participation. 
Reasons for non-participation in the study, provided by 89 participants who selected not to participate, are 
presented in Table 4-6. Twenty participants could not participate due to the selection criteria: they live/work 



Table 4-6: Reasons for Non-Participation (N=89) 



Category of Reasons 


Reasons for Non-Participation 


Participants 


Selection criteria 


Live or work in a country other than USA 


12 




Age is less than 18 


7 




Live in a country other than USA and age is less than 1 8. 


1 


Other reasons 


Not available for the interview due to business/vacation trip 


17 




No time for the telephone interview 


ii 




Non-regular user 


8 




Don’t have access to telephone 


5 




Want to be kept anonymous 


4 




AskERIC didn't/couldn’t answer the question 


4 




Made request for other people (i.e., proxy user) 


3 




Reasons other than above 


8 




Don’t want to participate in the study without specific reason 


9 


Cancellation 


Telephone interview was scheduled but the participant was absent 


10 


Total 




89 



8 "Reasons other than above" include loss of family member (2 respondents), anticipated child disturbance at the phone (2 respondents), critical to the methodology (1 
respondent), incorrect phone number (1 respondent), being a non-US citizen {1 respondent), and scheduled own surgery (1 respondent). 
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in a country other than USA and/or are younger than 18 years old. Others gave personal and work-related 
reasons that prevented them from participating in the study. These reasons may imply potential biases that 
might have operated in the self-selection process of the participants. Participants were likely to be more 
available at home or work place and less busy during the data-collection period. They were likely to be less 
concerned about privacy than non-participants. They have access to a phone. They were likely to be originators 
who made requests based on their own information needs - only one participant was a proxy searcher. They 
were likely to have received good answers from AskERIC before they received recruitment messages of the 
study. However, interview data demonstrated that two participants did not receive any response from AskERIC 
at the time of the interview and at least four participants reported that they received poor responses from 
AskERIC. 



In response to the agreement form , I sent an interview outline and the date and time of the telephone interview 
by e-mail. The recruitment process continued until theoretical saturation occurs. Theoretical saturation refers 
to the situation in which new data collected do not significantly contribute to the category being developed 
(Glaser & Strauss, 1967). When all categories reached this point, the collection of new data stopped. 

Among 75 participants who agreed to participate in the study, 10 dropped out because they were not available 
for the scheduled interview. As a result telephone interviews were conducted with 65 participants. 

DATA COLLECTION TECHNIQUE AND INSTRUMENTS 

The study data were collected by structured interviews. This section describes techniques and instruments 
used for data collection. 

Selection of Data Collection Technique 

Several data collection techniques might be applicable in eliciting situational factors possibly associated with 
the use of human intermediation. They are: (1) real-time observation; (2) real-time verbal reporting; (3) diary 
(4) interview (face-to-face, telephone); and (5) questionnaire survey with open-ended questions (group 
administration, postal mail, e-mail). Each methodology has its own advantages and drawbacks for the purpose 
of the study. 

Real-time techniques of observation are known to be more reliable than post hoc techniques in capturing a 
variety of internal behavior of users’ IPS processes. However, these techniques are very limiting for this study 
that intends to capture people’s IPS processes in a variety of settings. Real-time verbal reporting of the think- 
aloud technique has been widely used by IR researchers to capture the searcher’s thought process and 
accompanied stimuli during IR interaction (Fidel, 1991; Hert, 1995). However, this technique was not applicable 
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for the study that sought to identify factors associated with users’ decision-making processes of using human 
intermediation. That is, the occurrences of decision-making processes are hardly predictable. Thus, the 
researcher cannot plan to be there to observe the process. 

Since real-time techniques were not applicable, this study inevitably relied on users’ self-reporting at a later 
time when such decisions had already been made. This study employed a semi-structured interview technique 
in order to reduce such biases. Specifically, this study used a telephone interview with semi-structured questions 
supplemented by probe questions as well as with a few closed questions (see Appendix A4 for the interview 
guide). The reason for employing a telephone interview, rather than the face-to-face technique, was because 
most of the AskERlC clients live and work at a distance from the research site and it was almost impossible 
to arrange face-to-face interviews. The telephone interview was also appropriate for this study because the 
interviews could be arranged within an adequate time interval between the use of human intermediation and 
the self- reporting of the situations so as to increase the dependability of study data (Nisbett & Wilson, 1977). 

Modified Critical Incident Technique 

People’s recollection of their general behavior is known to be limited (Simon & Burstein, 1985). Thus, users’ 
self-reporting of recent real-life experiences concerning their use of human intermediation was elicited using 
an adaptation of the critical incident technique in order to increase the dependability and trustworthiness of 
the study. 

The critical incident technique is a systematic approach for eliciting and analyzing detailed reports of behaviors 
leading to successful or unsuccessful outcomes on a task or process. The technique was originally developed 
during World War II to identify the competencies involved in the successful performance of American bomber 
crews, and has been widely used to define the skill requirements of various occupations. It can be used in 
either structured interview, or written questionnaire, with open-ended questions (Flanagan, 1954). The 
technique has been extensively used in studying user behavior of information services and systems (Lindberg, 
et al., 1993; Saracevic & Kantor, 1997). 

The technique is very flexible in the way it can be adapted for a variety of settings, but should follow several 
basic principles: 

(1) Incidents to be reported should be critical for reporters, 

(2) Reporting of facts regarding behavior is preferable to the collection of interpretations, ratings, and 
opinions based on general impressions (Flanagan, 1954). 

This study might not necessarily fulfill these principles due to the fact that incidents (i.e., use of human 
intermediation) were selected by the research and, therefore, might not have been critical for the participants. 
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However, the purpose of the study was not to find situational factors that contribute to successful use of human 
intermediation in IPS but to elicit situational factors associated with the use of human intermediation and 
requests for a particular type of tasks. Thus, this study might not need to fulfill these requirements if incidents 
were important for reporters. In order to fill this gap, one item of the interview questions (Q6) asked about 
the relative importance of obtaining needed information that led participants to the use of AskERIC. The study 
found that the perceived importance of obtaining the required information was very high (mean = 8.5 and 
median = 10 on a scale of one to 10). Also, two items of the interview questions asked for participants’ 
evaluation of search results (Q21) and level of satisfaction with the use of AskERIC (Q22). The study also 
found that the evaluation score given by participants of search results was relatively high (mean = 8.3 and 
median = 9 5 on a scale of one to 10) and the satisfaction score for with the use of intermediation was very 
high (mean = 8.4 and median = 10 on a scale of one to 10). Thus, even though incidents reported were selected 
by the study, the relative importance of the incidents and a high level of success should have been maintained 
to ensure the memorability of the incidents. In addition, attention was paid to minimizing the time lag between 
the incident and the elicitation in order to minimize the possible memory loss. The telephone interviews were 
conducted within two weeks after AskERIC received the requests, since retention of memory is known to be 
dramatically reduced after two weeks (Flanagan, 1954). 

Data Collection Instruments: Interview Guide 

A modified critical incident technique was used in the telephone interview in order to capture participants’ 
internal (cognitive and affective) and external (social and environmental) situations prior to and at the moment 
when they made the requests. The use of a modified critical incident technique would help participants readily 
imagine themselves in the role and thus, in essence, recreate the situation. At the time when they were 
interviewed, all but two participants had received and examined responses from AskERIC to their requests 9 . 

The interviewer used an interview guide { Appendix A4) that contained questions and probes in an organized 
manner. The purpose of using the interview guide was to allow the interviewer to make the best use of the 
time available for the interview and make interviewing of different participants more systematic and 
comprehensive (Patton, 1990). However, this does not mean that interviews were conducted in stria linear 
manner. Rather, the participants were encouraged to "tell their own story in their own terms," (McCracken, 
1988) and the interview guide was used primarily as a checklist of areas that needed to be covered. In addition, 
each participant received an outline of the interview (Appendix A3) by e-mail a few days prior to the actual 
interview in order to help her/him prepare for the interview. 

DATA ANALYSIS TECHNIQUE 

Answers to closed questions were coded on the interview guide by the interviewer during the telephone 



9 AskERIC usually responds to clients within two business days after receiving requests. 
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interview, while answers to open-ended questions were content analyzed. This section describes techniques 
and instalments used for data analysis. 

Demographic Variables 

Though telephone interviews were conducted with 65 AskERIC clients who were willing to participate in the 
study, three interviews were discarded: two due to recording problems, and one due to too many discrepancies 
between the request message and interview data. Consequently, 62 participants’ IPS processes were analyzed. 

Table 4-7 summarizes the demographic variables of the 62 study participants. 



Table 4-7: Demographic Variables of Participants (N=62) 



Demographic Variables 


Number of Participants 


Occupation 


K-1 2 Teacher 


20 


(32.3%) 




Administrator/Manager 


9 


mnwmm 




Student 


8 


(12.9%) 






6 






K-1 2 Librarian/Media Specialist 


3 


(4.8%) 




Other 


16 


(25.8 %) 




Total 


62 


(100.0%) 


Work Experience 


Less than one year 


9 


(14.5%) 




One to five years 


20 


(32.2 %) 




Six to ten years 


7 


(11.3%) 




More than ten years 


26 


K3H9M 




Total 


62 


HiMdHHi 


Gender 


Female 


49 






Male 


13 


(21.0%) 




Total 


62 


(100 0%) 


Highest Education Completed 


Some college 


7 


(11.3%) 




Bachelor’s degree 


25 


(40.3 %) 




Master’s degree 


22 


(35.5 %) 




Certificate of advanced studies 


5 


(8.1 %) 




Ph D. or doctoral degree 


3 


(4.8 %) 




Total 


62 




Age 


18-25 


4 


(6.5 %) 




26-35 


10 


wnmmm 




36-45 


10 






46-55 


34 






56-65 


3 


(4.8%) 




Not Available 


1 


(1.6%) 




Total 


62 


(100.0%) 
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As shown in Table 4-7, participants represent a variety of occupations. Other than K-12 teachers who comprised 
one third of the participants, participants' occupations were diverse. "Other" categories include a variety of 
professions such as school counselor (1), school psychologist (1), reading consultant (1), speech language 
pathologist (1), instructional technology assistant (1), occupational therapist (1), video-tape editor (1), technical 
editor (1), urban planner (1), real-estate agent (1), telephone representative (1), registered nurse (1), process 
consultant (1), retail sales person, (1), self-employed scrap metallurgist (1), and homemaker (1). 

The population of AskERIC clients is known to be female dominated. Reflecting this tendency, a great majority 
of the participants were female. Participants have completed a relatively high level of education, with most 
holding a bachelor's (40.3 %) or master's (35 5 %) degrees but a wide range of educational levels were 
represented. Concerning the age of participants, a majority of them were between 46 and 35, but others were 
well distributed in a wide range of generations. 

Transcription of Interview Data 

The tape-recorded interviews were transcribed by a third person in order to keep the adequate distance 
between the data and the investigator (McCracken, 1988). Transcribed answers to open-ended questions were 
re-examined in order to make sure all the relevant information was included in the transcription. The interview 
transcriptions were content-analyzed. 

Content Analysis of Telephone Interview 

In the pretest, I used a systematic sampling technique (i.e., every second request received on particular days) 
and found major participation biases: (1) participants who requested a particular type of task were over 
represented, and (2) female participants were over represented. These participation biases led to the 
modification of the initial sampling framework and the use of theoretical sampling in order to obtain a maximum 
variability of tasks, within the context of the study setting so that the research should be able to answer RQ3 
( what patterns of associations, if any, are observed between users* situational factors and tasks requested of 
intermediaries?). However, I noticed considerable discrepancies between what the request message implied 
and what the participant said in the interview s/he had requested. Thus, the initial categories of request 
messages based on the modified taxonomy of tasks requested of intermediaries were not used in the subsequent 
data analysis. Instead, the taxonomy of tasks requested of intermediaries was further refined by categorizing 
the interview data to develop the final taxonomy that will be presented in Chapter 5 (Table 3-1). 

For situational factors, the initial data coding used a deductive (top-down) strategy by employing the modified 
taxonomy of potential factors associated with the use of intermediaries (Appendix B2 (2)) developed based 
on the literature and refined in pretest. An inductive strategy was introduced in the initial coding when situational 
factors were not adequately categorized using the initial coding scheme. Subsequent data analysis followed 
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inductive/deductive loops of modified constant comparative technique 10 . The final categories developed through 
the data analysis are presented in Appendix B2 (3). The modified constant comparative technique employed 
in the data analysis will be described in the next section. 

Modified Constant Comparative Technique 

As a general approach to qualitative data analysis, the constant comparative technique is concerned with 
generating and suggesting a number of categories, properties and hypotheses about the phenomenon of study. 
The technique consists of three overlapping stages of observation, coding and interpreting based on researcher 
judgments and inferences. Each stage consists of three component tasks of data collection, coding, and 
hypothesis generation, all combined to provide the means for careful examination of a phenomenon at a 
particular level of abstraction. 

The three stages of the constant comparative process developed by Shelly and Sibert (1992) are: 

• Stage one\ In the initial analysis stage, 1 was involved primarily in eliciting and categorizing data 
by assigning an appropriate code to each of the new data instances. Through this process, similar 
instances were grouped together as a category. In this early stage of coding, data instances were 
grouped in multiple ways, since early in the analysis it was not clear which categories would become 
fully developed and contribute to the hypothesis generation. 

• Stage two : As more data were collected and data instances were assigned codes, the emphasis 
shifted from data collection to within-category integration. That is, coded data instances were 
examined for the characteristics that determine their membership in the category in order to develop 
a list of properties for the category. However, the category and properties were dynamically changing 
until the analysis was completed. When the promising combinations of codes and properties 
emerged, data collection was discontinued and data analysis moved to the third stage. 

• Stage three : As the deductive/inductive loops continued, the focus was shifted to higher-level, 
more abstract representations of data - generation of working hypothesis through across-category 
integration. Once working hypotheses were generated, the analysis continued to explore the data 
in order to find out whether the working hypotheses applied. This iterative process continued until 
theoretical saturation was attained. 



,0 Some researchers call the approach of qualitative data analysis using constant comparative technique that initially begins with a top-down deductive loop based on 
some preconception as modified analytic induction (e.g., Silverman, 1993). 
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DATA ANALYSIS PROCESS 

This subsection summarizes the major analytical activities in the data analysis process. 

Sources of Data Used in the Analysis 

The following three data sources were used for data analysis: 

• Interview transcripts: the major data sources used throughout the analysis process. 

• Request messages: used to validate interview data in terms of topics or requests and tasks requested. 

• Interaction log: used to validate interview data in terms of what participants received from AskERIC 
in response to their requests. 

When the topic of a request message did not match the participant’s description of her/his request in the 
interview, the interviewer asked more questions to make sure the participant did not send another request 
that corresponded to the original request message. The failure of the matching occurred for one participant 
(P39), which led to the discarding of the interview data from the analysis. 

I recognized during the first wave of the telephone interviews that the tasks requested of AskERIC Q&A Service 
based on the preliminary analysis of request messages for the theoretical sampling often did not match what 
participants reported they requested in the interview, even though the topics of the request messages matched 
the topics they described. This unexpected situation led to the modification of the initial research design to 
use the interview transcript as the main source to elicit tasks requested and to exploration of the sources of 
such disagreements. 

Analytical Framework 

The following four analytical frameworks were used at different stages of data analysis: 

• Taxonomy of Tasks Requested of Intermediaries (see Appendix Bl), 

• Taxonomy of Situational Factors Associated with the Use of Human Intermediation, and (see 
Appendix B2), 

• Taxonomy of Evaluation Criteria (see Appendix B5), 

• Four temporal segments of participants’ IPS processes. 

The first three schemes were developed prior to the data collection, while the last framework was employed 
in a later stage of data analysis in order to introduce a useful partitioning of IPS processes so as to perform a 
comparative analysis of complex relationships among categories. 
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Sequence of Data Analysis Process 

Looking back, I identified six phases of the data analysis process, each concentrated on a particular analytic 
focus. The result of each phase shifted the focus of the subsequent phase of the analysis. 

Phase 1: Coding Variables 

As soon as data from 15 participants had been collected, transcribed and verified with the interaction log for 
the reliability check, I began coding using Atlas.ti - software for qualitative data analysis. The coding was done 
separately for the tasks requested and for the situational factors using a top-down strategy employing each of 
the first two analytical frameworks respectively. Coding of the tasks requested of human intermediation was 
done separately for the request messages and the interview data in order to examine the extent of agreement 
between these two. The unit of coding was on the paragraph level of interview data I partitioned in advance. 
First, a code category (e.g., tasks requested of intermediary) was assigned to the paragraph that captured the 
answer to a particular interview question (e.g., Q7). However, when the answer to a question was scattered 
over multiple paragraphs within an interview transcript due to maxim (Grice, 1975), a code category was 
assigned to each of relevant paragraphs. Second, sub-codes representing members of the category (e.g., a 
particular task requested) were assigned to each of the paragraphs. As new interview data were collected and 
transcribed, they were also coded. Through this initial coding, a few categories were discarded from initial 
frameworks, while several new categories were added. 

Phase 2: Within Category Integration 

Phase 2 of the analysis was also done separately for the tasks requested of intermediary and for the situational 
factors. The inter-coder reliability check was performed separately for coding of the request messages and the 
interview data using stratified samples (every sixth) of 10 request messages and the portions of interview data 
captured as relevant to the category in the phase 1 of the data analysis. The coefficients of reliability were 
lower for request messages (.72) than the interview data (.94) in terms of Kappa. The two distributions of task 
codes assigned to the request messages and the interview data for identical participants were compared, and 
a very low level of full agreement between the two (29 0 %) was obtained. At this point, I was convinced that 
the task code assigned to the request messages was not reliable; that led to some modification of the initial 
research design of using request messages as the bases of the tasks requested of intermediaries for the later 
analysis into a new design that employed tasks based on the interview data instead. In addition, plausible 
explanations for inconsistencies between request messages and interview data were explored. The results will 
be reported in Chapter 5. The final taxonomy of tasks requested of intermediaries is presented in Table 5-1. 
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For situational factors associated with the use of human intermediation, patterns of associations within each 
category were explored for the following nine categories: 

1) Information needs 

2) Goal-generating factors 

3) Social function of user 

• Capacity acted by user in IPS (pre-defined and elicited in the interview) 

• User role in IPS (pre-defined and elicited in the interview) 

4) Searching behavior 

3) Experience of using AskERIC Q&A (pre-defined and elicited in the interview) 

6) Perceived level of IPS skill (identified through constant comparative process) 

7) Image of AskERIC Q&A (identified through constant comparative process) 

8) Evaluation of human intermediation 

• Evaluation score (elicited in the interview) 

• Level of satisfaction (elicited in the interview) 

• Evaluation criteria (identified through constant comparative process using a top-down strategy 
employing Taylor’s (1986) value-added model) 

9) Information use 

• Artifact development 

• Information sharing 

Phase 3: Find Focus on User Goals 

The recognition that participants articulated their goals in multiple levels and referred to them in explaining 
their IPS behavior led the study to further explore the user goals. The study used the concept of goals in 
Bandura's (1989) social cognitive theory in the analysis and captured goals in three levels: 

• Goals of using the AskERIC Q&A Service 

• IPS goals 

• Higher-level goals 

Each participant's goals were summarized on the above three levels as presented in Appendix Cl. Based on 
the analysis, IPS goals were grouped into eight properties and relationships between IPS goals and goals of 
using the AskERIC Q&A Service were identified (Table 5-1). 
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Phase 4: Find Focus on Reasons for Using AskERIC Q&A Service 

I noticed by reviewing the part of the interview transcripts that captured reasons for selecting the AskERIC 
Q&A Service (answers to interview question Q12) that participants used many causal and temporal conjunctions. 
This recognition led the study to analyze causal and temporal relationships between reasons. This idea was 
also guided by the analytical technique of "pattern coding" recommended by Miles and Huberman (1994, p. 
69). Causal and temporal relationships between two reasons were first identified within interview data of 
individual participant, and coded as "A=>B" for causal relationship and "A)B" for temporal relationship using 
causal terms (e g., because, so, since, etc.) and temporal terms (e.g., when, then, after, as soon as, etc.). A 
global level of causal and temporal relationships of reasons shared among participants was developed as 
shown in Appendix C2. A visual map of relationships between reasons articulated by two or more participants 
was generated using the network editor of Atlas.ti (Figure 7-1). By examining the figure, 1 identified three 
situational variables as representing different patterns of causal and temporal relationships between reasons. 
They are: (1) whether participants did self-searching before sending the requests, (2) whether participants had 
experience of using the AskERIC Q&A Service , and (3) perceived level of participants' own IPS skill . This 
recognition led the study to analyze patterns of associations between reasons for using the AskERIC Q&A 
Service and these three situational variables. 

Phase 5: Across-Category Integration # 1 

The associations between variables under different categories were explored by comparing values of variables 
between categories as well as by extracting relevant data instances that identified the extracted relationships. 
The level of analysis was on the individual participant. Through this process, a conceptual model that represents 
associations identified among user goals, tasks requested, and situational variables was developed (Figure 9- 
1 ). 

Phase 6: Across-Category Integration #2 

Finally, the third analytical framework of the "segments of IPS process" was introduced in the analysis in order 
to find patterns of changes in values of information needs, and affective states. 

Even though all IPS processes studied in this research used the AskERIC Q&A Service, each of them represents 
a different information need and exhibits different information-seeking behavior. Since the purpose of this 
study was to identify patterns shared among the various IPS processes, it was necessary to impose some useful 
partitioning of these IPS processes in order to make it possible to perform a comparative analysis. 

Based on the constant comparative analysis of each of the IPS processes collected from 62 participants, I 
grouped them into the following three patterns: 
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1) FuUy-dependent searching: Participants went directly to send requests to the AskERIC Q&A 
Service, without making any effort to find information by themselves. After sending the requests, 
they waited for the responses from the service without making any efforts to locate needed 
information from other sources/services until they received responses from the service. 

2) Last-resort searching : Participants tried to find information from other sources by self-searching 
or mediated/delegated searching before they sent requests to the AskERIC Q&A Service. After 
sending the requests, they waited for the response from the service without making any efforts to 
locate needed information from other sources/services until they received responses from the 
service. 

3) Parallel searching : Participants tried to find information from other sources/services by self- 
searching and/or mediated/delegated searching before they sent requests to the AskERIC Q&A 
Service. After sending the requests, but before receiving the responses from the service, they 
continued searching for information from other sources/services by self-searching and/or 
mediated/delegated searching. 

These three patterns are described in three process charts in Figure 4-3- In each section of the chart, numbers 
preceded by a capital letter "P" represent a participant's ID number. The location of an ID number indicates 
the progress of the participant's IPS process at the time of the data collection. Since. two participants engaged 
in last-resort searching (PI 2 and P34) reported they did not receive any response from the AskERIC Q&A 
Service, their IDs are located under "Sent Requests" in the process chart. 

As shown in these process charts in Figure 4-3, participants' IPS processes before receiving responses from 
AskERIC were relatively simple. But they were very complex after receiving the responses, reflecting the 
characteristics of responses, the complexity of participants' information needs, and their internal and external 



Table 4-8: Segmentation of IPS Processes 



Segmentation 


Segment 1 


Segment 2 


Segment 3 


Segment 4 


Description 


Generation of 
information needs 


IPS processes before 
sending requests 


IPS processes between 
sending requests and 
receiving responses 


IPS processes after 
receiving responses 


Common IPS 
Activities 


- Planning 


- Self-searching 

- Delegated/ mediated 
searching 

- Selecting AskERIC 


- Sending requests to 
AskERIC 

- Receiving responses 
from AskERIC 


- Evaluate responses 

- Develop artifacts 

- Share information 



r\ 



1 OB 





















Chapter 4: Methodology of the Empirical Study 



situations. Thus, it was very difficult to categorize these patterns further, but after preliminary analysis (inter- 
category integration) of participants’ IPS processes described above, I partitioned them into four segments as 
described in Table 4-8. 

Software Used for Data Analysis 

Atlas.ti, a software package for qualitative data analysis and management, was used to analyze data all through 
the research process. This software is capable of storing textual data in an organized format and allows the 



Figure 4-3: Three Patterns of IPS Processes 



(1) Fully-Dependent Searching (10 participants) 

Sent Request ► Received Response 



Sent New Request 




P6 




Passed to Others 




P18P33 




Follow-up Responses - 


— ► Closure 


P2P27 


P13P50 


Self-Searching 


— Closure 




P4 


Closure 




P15P21 





(2) Last-Resort Searching (39 participants) 

Self-Searching »-Sent Request —►Received Response 

Delegated Searching ► PI 2 P34 PI 0 P58 



Information ► Closure 

Encountering PI 9 

Closure 

P9 P26 P29 P48 



Follow-up Responses 
PI P3 P8 P23 P30 
P42P45P47 P52 
P56P59P64 




Closure 

P14P31 P35P38P43 
P46P49P55 P57P62 
Self-Searching —►Closure 
P41 P65 



Self-Searching ► Closure 

P16P22P60 P7P25 



(3) Parallel Searching (13) participants) 

Self-Searching — ► Sent Request — *► Received Response 
I AP20 



Self-Searching ► 



•— ► Delegated Searching — ► 



Information Encountering -► 

Passed to Others 
P5 



Follow-up Responses 



P17P40 

Closure 
P28 P32 P53 



Closure 

P44 



Self-Searching 
P24 P51 

Closure 
P54 P63 



Closure 
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coder to code any portions of data as quotations. Also, the software can present the analyzed data (quotations, 
codes, relations, etc.) in a variety of formats including frequency tables, code families, and network display. 
The software was useful in recording variety of memos in order to keep track of the research process. I 
familiarized myself in using the software prior to the conduct of the study by using it in coding and analyzing 
the pretest data. 

METHODOLOGICAL LIMITATIONS OF THE STUDY 

Any research has its limitations. This study was limited in capturing only those instances of human 
intermediation performed by a formal information service provided free of charge through an online 
environment on the Internet within the domain of education. In addition, findings of this study have the 
following limitations due to the methodology. 

• Geographic settings: due to the fact that the study uses telephone interviews in data collection in 
order to capture participants’ situations as naturally as possible, and due to limited resources, only 
those users who lived in the U.S. were recruited. Thus, situations covered by the study are limited 
to the settings of the geographic and cultural boundary. 

• Age: because of the ethical and practical complexities that might result from recruiting minors, that 
necessarily involves their parents who have the right to be involved, this study recruited only adults. 
Thus, situations and settings covered by the study were limited to the adult population. 

• Important and memorable situations: the study captured post-hoc self-reporting by participants of 
situations that might be associated with their use of human intermediation. Thus, this study captured 
only those situations that were important, memorable, specific and legitimate to participants. As a 
result, this study generated only a very limited picture of participants’ internal and external situations 
possibly associated with their use of human intermediaries. 

The phenomenon of study, the use of human intermediation, is the core issue of information professionals 
who have been striving to provide better service in ever-changing environments. In order for information 
professionals to serve in this function, they need to obtain a deeper understanding of the phenomenon from 
the users’ perspective. But existing models and findings are mostly derived from information professionals’ 
perspectives. Thus, these models and findings do not provide an adequate level of understanding of why and 
in what situations people make use of human intermediation. Thus, seeking a better understanding of the 
phenomenon from users’ perspectives is a very important research agenda in information science, even though 
the findings are known to be very limited. 
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This study was merely a starting point to explore and understand the phenomenon rather than to prove or 
generalize from existing models and findings. Even though study findings are limited, the study has generated 
new hypotheses and new research questions. Thus, subsequent research will build upon the study findings 
and new research questions. 

SUMMARY 

This chapter has outlined assumptions, challenges, and the overall research design with techniques employed 
for data collection and analysis, as well as the methodological limitations. The research design of a naturalistic 
study evolves through inductive/deductive processes of data collection and analysis. This chapter, however, 
has identified and described major components of the study in order to indicate the rationale with which the 
study was formulated and conducted. 

The goal of the study was to develop a better understanding of the complex phenomenon of the use of human 
intermediation in IPS processes as seen from users' perspectives. This chapter has argued for the adequacy of 
the naturalistic research approach taken by the study. The research activities were outlined as eliciting and 
building perspectives of users of human intermediation through iterative processes of data collection and 
analysis. Selecting clients of an Internet-based digital reference service for data collection may have limited 
the transferability of the study findings but provided an opportunity to investigate deeply the settings of users 
and descriptions of their situations. 

Findings of the study might be limited due to the shortcomings of available methodology in capturing internal 
processes of humans in a post hoc manner. The study was an initial attempt to obtain insights into some general 
situations of users who make use of human intermediation. Also, the study was expected to generate new 
hypotheses to be tested and research questions to be explored in subsequent research built upon this one. 





CHAPTER 

FIVE 




TASKS REQUESTED 
OF HUMAN 
INTERMEDIARIES 

One of the goals of the study was to develop a taxonomy of tasks requested of human intermediaries. By 
presenting the taxonomy, this chapter provides answers to the research question RQ1: what kind of tasks do 
users request of human intermediaries? Rather than develop a new taxonomy from scratch, an existing 
framework was used and refined in order to take an advantage of the cumulative nature of scientific research. 
The Big 6 Model (Appendix B1 (1)) was chosen as the initial framework, because it was acknowledged to be 
more flexible than other models in capturing a variety of IPS processes of different people in different settings 
(Eisenberg & Lowe, 1997). A sample of request messages was used to develop and refine the taxonomy, with 
the assumption that people had a clear idea of what they requested of AskERIC and that such an idea was 
reflected in the request messages. This chapter describes how such taxonomy was developed and applied in 
the analysis of study data, with an unexpected finding of discrepancies of requested tasks between request 
messages and interview data. 

DEVELOPING THE TAXONOMY OF 

TASKS REQUESTED OF HUMAN INTERMEDIARIES 

In developing the taxonomy, a sample of 500 request messages received by the AskERIC Q&A Service in April 
1998 was analyzed using a top-down strategy of content analysis technique. An inductive strategy was 
introduced whenever the initial framework did not adequately categorize request messages. The resulting 
interim taxonomy (see Appendix B1 (3)) was used as a tool for a theoretical sampling of participants of the 
study in order to obtain a maximum variation of samples within the limitation of the study site (i.e., the AskERIC 
Q&A Service) from which they were recruited. 
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Three major problems were encountered in applying the Big 6 Model { Appendix B1 (1)) to categorize request 
messages. This led to a modification of the initial framework. The problems and solutions adopted are: 

Problem 1: The term "information” is used without a clear definition in the Big 6 Model. On the other 
hand, "information" is defined as "... that which modified... knowledge structure... " (Brookes, 1980, 
p. 197) by those who take users' perspectives in IR/IPS research. As this takes a users' perspectives, 
so I considers that a message can be judged as "information" only by the recipient of the message. 
Using this definition, find information tvitbin sources 0.2) in the Big 6 Model may be understood as 
either "find metadata of sources (e.g., documents, websites, etc.) within IR systems (e.g. the Internet, 
the ERIC database, a library, etc.)," or "find meaning of a substantive content of sources," depending 
upon what searchers are looking for. Similarly, extract information from a source (4.2) in the Big 6 
Model may be understood as either "extract metadata within IR systems," or "extract a meaning of a 
part of a substantive content of a source that is determined as ‘information’ by a user." 

/ Solution: Distinguish between requests of sources and those of substantive content of information 
of sources by refining the model. Combine: Determine the range of possible sou rces (2.1), Evaluate 
the different possible sources to determine priorities (2.2), and Locate sources (intellectually and 
physically) (3-1) of the Big 6 Model to develop the category of SOURCE LOCATING TASK (TASK 
C of the final taxonomy). Also, combine: Find information within sources (3-2), Extract information 
from a source (4.2), and Synthesis (5) of the Big 6 Model to develop the category of CONTENT 
HANDLING TASK (TASK D of the final taxonomy). 

Problem 2: "Information-seeking strategy (2)" in the Big 6 Model is defined as "examining alternative 
approaches to acquiring the appropriate information to meet defined tasks" (Eisenberg & Berkowitz, 
1995, p. 22) which implies the development of a search strategy. However, two components of the 
category, determine the range of possible sources (2.1) and evaluate the different possible sources to 
determine priorities (2.2), imply that this category is focused on evaluation and selection of sources, 
rather than development of search strategies perse . Thus, there was a difficulty categorizing request 
messages that asked for search strategies such as directions, search steps, appropriate commands and 
keywords. 

/ Solution: Develop the category of SEARCH STRATEGY (B_STR) to capture requests asking for 
search strategies but not for recommendation of sources. 
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Problem 3: "Synthesis (5)" in the Big 6 Model is defined as "integrating information drawn from a 
range of sources," implying that the final product of an IPS process is generated by combining extracted 
information from a range of external sources. Many AskERIC requests, however, sought suggestions 
or opinions (internal knowledge) of intermediaries on a participant’s decision/action, rather than 
synthesized information from multiple external sources. 

/ Solution: One’s opinion can be generated by synthesizing information from multiple external 
sources (media, literature, people, etc.) as well as by one’s own internal knowledge. Thus, a 
request of an intermediary’s opinion can theoretically be considered as a request of synthesized 
information. At the same time, I recognized in analyzing request messages and interview data 
that the requests of extracting and synthesizing the contents of sources are rather distinctive from 
the requests of experts’ opinions. The solution was to develop three sub-categories under the 
category of CONTENT HANDLING (TASK D) of the final taxonomy so as to be able to capture 
separately the tasks of FACT-FINDING (D1_FAC), SYNTHESIZING (D2_SYN), and OPINION- 
GENERATING (D3_OPI). 

THE TAXONOMY OF TASKS REQUESTED OF HUMAN INTERMEDIARIES 

The final taxonomy (Table 5-1) includes the following seven categories: 

• TASK DEFINITION (A _DEF): The category is defined as "requests to provide suggestions on what 
to do to meet the information need" which includes requests of suggestions of topics (of papers 
and thesis, etc.) and IPS procedures (e.g., instructions on how to develop a particular artifact, etc.). 
It corresponds to task definition of the Big 6 Model. 

• SEARCH STRATEGY (B_STR): The category is defined as "requests to provide suggestions on 
approaches or strategies to find information" which includes requests of instructions on how to find 
information, and suggestions on appropriate operations (of steps, commands, keywords, etc.). It is 
conceptually analogous to information seeking strategy (2) of the Big 6 Model but does not include 
its two components (i.e., 2.1 determines the range of possible sources; and 2.2 evaluate the different 
possible sources to determine priorities). 

• SOURCE LOCATING (C): The category corresponds to Locate sources (31) of the Big 6 Model, 
but is divided into two sub-categories in order to reflect the distinction between requests for finding 
potential sources of relevant information and requests for physically delivering sources or for 
instructions on how to obtain known sources. 

- SOURCE FINDING (Cl JLOC): This sub-category is applied to requests for intellectually locating 
sources and defined as "requests to identify potential sources of relevant information (including 
electronic, print, human, organizational, etc.) or provide metadata of these sources." 
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* SOURCE OBTAINING (C2_ACC): This sub-category is applied to requests for physically locating 
sources and defined as "requests to deliver or provide instructions on physically obtaining 
known sources including ERIC documents." 

• CONTENT HANDLING (D): This category was developed to capture requests that ask for 
manipulation of contents of sources to provide information and was divided into three sub-categories 
to reflea different levels of manipulation. 

- FACT FINDING (D1_FAC): This sub-category is applied to requests for extracting factual 
information (e.g., statistical, historical, legal or geographic data/information; mathematical/scien- 
tific formulas; definitions of concepts; contents or quotations of documents, etc.) from sources. 

- SYNTHESIZING (D2_SYN): This sub-category is applied to requests for synthesized information 
obtained from multiple external sources (e.g., summary of literature on a topic, etc.). 

- OPINION-GENERATING (D3_OPl): This sub-category is applied to requests for opinions/sug- 
gestions on a participant’s decision or action. 

• EVALUATING (E_EVA): This category is defined as "requests to evaluate IPS processes (i.e., 
adequacy of sources and/or search strategies)". It corresponds to Judge the information problem 
solving process (6.2) of Evaluation (6) of the Big 6 Model 

• UNSPECIFIED TASKS (F): The category was developed to capture requests that cannot be 
categorized in any of the above specific tasks due to the ambiguity of the request messages and/or 
the articulation of indefinable tasks in interview data. 

- AMBIGUOUS REQUEST (F1_AMB): This sub-category applies to request messages and/or 
interview data that due to its ambiguity did not provide sufficient information to categorize 
tasks requested of intermediaries. 

- ANY/ALL TASKS (F2_ANY): This sub-category is for requests that ask for unspecified tasks 
that lead to the achievement of the user’s IPS goal. 

• OTHER TASKS (G_OTH): This category was developed to capture tasks that cannot be categorized 
by any of the above categories. Requests that fall in this category were either questions about specific 
ERIC or AskERlC procedure or requests for sources of grants, promotions, etc., but not for 
information. 

The final taxonomy was then applied to the request messages and interview data of the 62 participants of this 
study. The result will be presented in the next subseaion. 
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Table 5-1: Taxonomy of Tasks Requested of Human Intermediaries 



Task Type 


Code 


Description 


Corresponding Items 
in Big 6* 


A: TASK DEFINITION 


A_DEF 


Provide suggestions on what to do to meet the information 
need (e.g., clarify information need, decide/focus the topic, 
etc.) 


1 Task definition 


B: SEARCH STRATEGY 


B_STR 


Provide suggestions on approaches or strategies to find 
information (e.g., how to find information, which keywords 
to use, etc.) 

■=> If requesting "how to locate specific known 
documents, use C2_acc 


2 Information- 
seeking strategies 


C: SOURCE 
LOCATING 


SOURCE 

FINDING 


C1_L0C 


Identify potential sources of relevant information (including 
electronic, print, human, organizational, etc.) or provide 
metadata of these sources. 

o If requesting physically sending known documents or 
an instruction of document delivery, use C2_acc 
■=> If requesting sources but not for information, use 
G_oth 


2.1 Determine the 
range of possible 
sources 

2.2 Evaluate the 
different possible 
sources to deter- 
mine priorities 

3.1 Locate sources 
(intellectually) 




SOURCE 

OBTAINING 


C2_ACC 


Deliver or provide instructions on physically obtaining 
known sources including ERIC documents (i.e., document 
delivery request; request of direct links to electronic fulltext 
documents; request of instruction on how to obtain known 
documents.) 


3.1 Locate sources 
(physically) 


D: CONTENT 
HANDLING 


FACT 

FINDING 


D1_FA 


C Find and extract factual information or data (e.g., 
statistical, historical, legal or geographic information/data; 
mathematical/ scientific formulas: definitions of concepts: 
contents or quotations of documents, etc.) from sources 
and present it to users. 


3.2 Find information 
within sources 

4.2 Extract information 
from sources 

5 Synthesis 




SYNTHESIZING 


D2_SY 


N Synthesize information obtained from multiple external 
sources (e.g., summary of literature on a topic) and present 
it to users. 






OPINION- 

GENERATING 


D3_0PI 


Provide opinions/suggestions on users’ decision or action. 




E: EVALUATING 


E_EVA 


Evaluate IPS processes 0- e., adequacy of sources and/or 
search strategies) 


6.2 Judge the 
information 
problem-solving 
process 



F: UNSPECIFIED AMBIGUOUS F1_AMB Request message or interview data did not provide 

TASKS REQUESTS sufficient information to categorize the task because of 

ambiguity 



ANY/ALL F2_ANY User is not expecting any particular tasks but appreciates 
TASKS anything that leads to achievement of his/her IPS goal. 

G: OTHER G_0TH Tasks that cannot be categorized above. This category may 

TASKS include request of sources but not for information and 

questions about specific ERIC or AskERIC operations. 

'Complete Big 6 Model is presented in Appendix B1 (1). 
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COMPARISON OF REQUEST MESSAGES AND INTERVIEW DATA 

I recognized during data collection (i.e., telephone interview) that there were considerable discrepancies 
between what the original request message implied and what the participant later said in the interview had 
been requested of the AskERIC Q&A Service. Thus, the original request messages and the interview data were 
coded separately using the final taxonomy in order to identify the magnitude of discrepancies between them. 
An inter-coder reliability check was performed for both coding of request messages and interview data using 
Kappa (Cohen, I960), and the resulting coefficients of reliability were .72 and .94 respectively. 

INCONSISTENCIES OF TASKS REQUESTED 
BETWEEN REQUEST MESSAGES AND INTERVIEW DATA 

Table 5-2 compares two distributions of task codes assigned to request messages and interview data for identical 
requests. In this table, the number of requests of which task codes of request messages corresponds to that 
of interview data are shown in bold italic. 

As shown in Table 5-2, agreement of task codes between request messages and interview data was very low. 
A full agreement of task codes was obtained for 18 requests (29-0 %) on the sub-category level, and 24 requests 
(38.7 %) on the category level. The low level of agreement of task codes between the request messages and 
the interview data was unanticipated. 



Table 5-2: Task Codes Assigned to Request Messages and Interview Data (N=62) 



Request messages 


Interview 


A 


B 


Cl 


C2 


D1 


02 


D3 


E 


FI 


G 


C2/D1 


D1/D3 


D1/D3/E 


D2/D3 


total 


B 




i 






1 




1 




1 












4 


Cl 






7 




1 


1 


7 




2 












18 


C2 








6 














1 








7 


D1 




1 


1 




1 




3 










1 






7 


D2 












1 


















1 


D3 














1 




1 












2 


E 






























0 


F2 




1 










2 
















3 


G 














1 






1 










2 


A/C1/D1 




























1 


i 


B/C1 


1 


1 


2 




1 




1 
















6 


B/D1 














1 
















1 


C1/C2 








1 






















1 


C1/D1 






1 




1 


1 


1 










1 






5 


C2/E 


























1 




1 


D1/D2 




i 




1 






















2 


D1/D3 














1 
















1 


total 


1 


5 


11 


8 


5 


3 


19 


0 


4 


1 


1 


2 


1 


1 


62 



* Task codes agreed by both request message and interviews are in bold italic. 
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EXPLORATION OF POSSIBLE SOURCES OF INCONSISTENCIES 

Possible explanations were explored in order to identify plausible reasons for the disagreement between 
request messages and interview data in terms of task requested of intermediaries. 

Difficulty of Articulating Tasks in Request Messages 

Tire phenomenon of difficulty in articulating information needs was proposed by Taylor (1962, 1968) and 
supported by the ASK hypothesis (Belkin, et al, 1982a), sense-making theory (Dervin & Nilan, 1986), and 
researchers who take a cognitive perspective in IR research (Ingwersen, 1992). 

Three participants reported during the interview that they had difficulty wording request messages due to the 
ambiguity of their information needs’. Seven others claimed that inappropriate wording of request messages 
might have caused the unexpected responses they received from the AskERIC Q&A Service. Thus, at least 10 
participants (16.1 %) were identified to have had problems in articulating their information needs in request 
messages. Among these 10, only one participant’s request was assigned an identical task code for both the 
request message and the interview data. These results imply that the difficulty in articulating information needs, 
perceived by participants, was one of the major reasons for disagreement of task codes between request 
messages and the interview data. 

Ambiguous Request Messages 

The inter-coder agreement of the coefficient pf reliability in terms of Kappa of the coding of the request 
messages was .72, which is considered to be relatively low. This low level of Kappa is in contrast to a relatively 
high level of Kappa (.94) obtained for the inter-coder agreement of coding of the interview data. All six coders 
who participated in the reliability check unanimously agreed on the difficulty of assigning task codes because 
of the ambiguity of the request messages. This implies that the ambiguity of request messages may be a source 
of disagreement of task codes between request messages and interview data. 

Modification of Information Needs 

One of the common theoretical premises of user-based approaches in IR and IPS research is the modification 
of information needs through IR interaction processes (Belkin, et al., 1982a; Dervin 8c Nilan, 1986; Bates, 1989; 
Katzer & Snyder, 1990; Harter, 1992). This perspective suggests that the modification of information needs 
themselves may have been the source of inconsistency between task codes assigned to request messages and 
interview data. Since the interview was performed 7-14 days after the AskERIC Q&A Service received 
participants’ request messages, there was plenty of time for participants to modify their information needs. 
They may have reported in the interview the tasks they requested based not on the information needs at the 
time they wrote request messages but on the information needs at the time of the interview. 



' Data instances are provided in Appendix D1 . 
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Ten participants reported that their information needs were modified during the time interval between sending 
requests and receiving responses. The modifications were reported in one or more of the dimensions including 
IPS goals, the type of information needed, the topic, and the focus. Among them, only two participants had 
the identical task code for both the request message and the interview data (agreement - 20.0 %). This suggests 
the possibility that the modification of information needs may be a source of inconsistencies of task codes 
between request messages and interview data. 

Testing the Service without Requesting Specific Task 

Nineteen participants made requests not only to find information but also to test the AskERIC Q&A Service. 
Of these 19, 18 were first-time users of the AskERIC Q&A Service. Four of them reported in the interview that 
they did not have any particular tasks in mind but wanted to see how the service works. They said they were 
open to any responses 2 . As a result, their requests were coded as either UNSPECIFIED TASK (F2_ANY) or 
received multiple task codes. This suggests that participants who had no experience of using the service might 
have written their own IPS goals, rather than specific tasks. This idea was explored by comparing participants’ 
experience in using the service with the agreement of task codes between their request messages and interview 
data. The result is presented in Table 5-3. 

As shown in Table 3-3, not much difference was observed between participants who had experience in using 
the AskERIC Q&A Service and those who had no experience. This suggests that experience in using the service 
was not a source of inconsistency of task codes between request messages and interview data. A similar 
analysis was performed for the 19 participants who had the common goal of testing the service, and found 
that agreement of task codes between request messages and interview data was achieved for about a quarter 
of them. This suggests that the participants’ experience in using the service and their common goal of testing 
the service were not the major sources of inconsistency of task codes between request messages and interview 
data. 



Table 5-3: Experience in Using the AskERIC Q&A Service and Agreement of Task Codes Between Request Messages and 
Interview Data (N=62) 



Experience in Using the AskERIC Q&A Service 


Agreement of Task Coc 


les Between Request Messages and Interview Data 




Agree 


Disagree 


Total 


Yes 


5 (26.3 %) 


14(73.7%) 


19(100.0%) 


No 


13(30.2%) 


30 (69.8 %) 


43(100.0%) 


Total 


18(29.0%) 


44(71.0%) 


62 (100.0 %) 



2 Data instances are provided in Appendix D2. 
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Short Nature of Request Messages 

Many of the request messages were very short. The two shortest request messages consisted of only 8 words, 
the longest, of 310 words. The mean length was 41 words and the median was 27. Examples of short, medium, 
and long request messages are presented in Appendix D3. The idea that the short nature of request messages 
might have caused discrepancies of task codes between request messages and interview data was considered. 
A possible association between the length of request messages and inconsistencies of task codes between 
request messages and interview data was explored. Request messages were divided into three groups in terms 
of word count, and ratio of the number of participants whose task codes agreed between request messages 
and interview data was calculated for each group. The result of the analysis is presented in Table 3-4. 

As shown in Table 5-4, not much difference was observed among the three groups, even though participants 
who sent long (41 or more words) request messages had a somewhat higher level of agreement. This suggests 
that the length of request messages was not a major source of discrepancy of task codes assigned to request 
messages and interview data. 



Table 5-4: Length of request Messages and Agreement of Task Codes Between Request Messages and Interview Data (N-62) 



Length of Request Message (word count) 


Agreement of Task Codes Between Request Messages and Interview Data 




Agree 


Disagree 


Total 


Short (1 -20 words) 


5 (26.3 %) 


14(73.7%) 


19(100.0%) 


Medium (21-40 words) 


7 (25.0 %) 


21 (75.0 %) 


28 (100.0%) 


Long (41 or more words) 


6 (40.0 %) 


9(60.0%) 


15(100.0%) 


Total 


18(29.0%) 


44(71.0%) 


62 (100.0%). 



PLAUSIBLE REASONS FOR INCONSISTENCIES 

As a result of exploratory analysis, the following three sources are therefore suggested as likely reasons for 
the low level of agreement of task codes assigned to the request messages and to the interview data. 

(1) difficulty of articulating tasks in request messages, 

(2) ambiguous request messages, and 

(3) modification of information needs in the interim between request and interview. 



Thus, the initial assumptions made by the study that people had clear ideas of what they requested of 
intermediaries and that such ideas ought to be reflected in request messages were proven wrong. Among the 
above three plausible reasons for the disagreement, the first two are related to the lack of interaction in the 
question negotiation of digital reference services (Lankes, 1998; White, 1999). 



m 

























Use of Human Intermediation in Information Problem Solving: A Users Perspective 



In the telephone interview, support for the inclusion of interactivity in the question-negotiation was suggested 
by three participants. All of these three had inconsistencies of task codes between request messages and 
interview data, and they evaluated negatively the responses they received from AskERIC. On the other hand, 
four participants reported that they had interactions with the AskERIC intermediaries before receiving the final 
responses, and they evaluated the final responses they received from the service as perfect. These contrasting 
cases suggest the significance of interactions in achieving a high level of common understanding of information 
needs between users and intermediaries. 

Perhaps the telephone interview performed in the data collection of this study could be considered analogous 
to interaction in the question-negotiation processes, because it elicited participants’ information needs as well 
as relevant situational factors in the participants’ IPS processes of the requests 3 . Assuming that the analogy is 
real, the different levels of the reliability of inter-coder agreement of task codes between request messages 
and interview data in the study may demonstrate the different levels of performance between the question 
negotiation processes without interaction and those with interaction. If so, this finding suggests the significance 
of interaction in question negotiation processes for achieving a high level of common understanding of tasks 
requested of intermediaries between a user and an intermediary. 

The above analysis also suggests that the initial research design of categorizing requests based solely on request 
messages was inexpedient. Hence, request messages need much clarification through interaction to achieve 
a good understanding of the tasks that requesters want performed for them. As a result, the initial research 
design was modified and tasks requested of AskERIC as captured in the interviews rather than in the request 
messages were used for the later analysis of patterns of associations between situational factors and tasks 
requested of human intermediaries, which will be discussed in Chapter 9- 

SUMMARY 

This chapter reported study findings on tasks requested of the AskERIC Q&A Service and provided answers 
to the research question RQ1: what kind of tasks do users request of human intermediaries? The taxonomy of 
tasks requested of human intermediaries was developed based on the analysis of a sample of past request 
messages received by AskERIC. The taxonomy was applied in the analysis of 62 participants’ request messages 
and interview data. 

Considerable discrepancies were identified between tasks codes assigned to request messages and interview 
data of identical requests, that led to an exploratory analysis in search for sources of inconsistencies between 
them. Three plausible reasons for such discrepancies were (1) difficulty of articulating tasks in request messages, 



3 1 admit that the interview was different from question-negotiation in terms of time intervals and sequences, while an interactive question negotiation typically occurs as 
soon as a user asks a question or submits a request; the interview was performed 7-1 4 days afterwards, tn addition, interactive question negotiation is usually performed 
before a user receives a response from an intermediary, while the interview was performed after they received it. 
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(2) ambiguous request messages, and 0) modification of information need between the time of sending request 
messages and the time of telephone interview. First two reasons are related to lack of interaction in question 
negotiation processes generally observed among DRSs. This Finding implies the significance of interaction 
between users and intermediaries in question negotiation processes to achieve a high level of common 
understanding of users’ information needs. The Final taxonomy of tasks requested of human intermediaries is 
not very reliable for categorizing tasks based on the analysis of one-shot request messages, but likely to be 
reliable when highly interactive question negotiation is performed. 
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CHAPTER 

SIX 



SITUATIONAL FACTORS 
ASSOCIATED WITH 
THE USE OF HUMAN 
INTERMEDIATION 



This chapter reports the study’s findings regarding situational factors associated with the use of the AskERIC 
Q&A Service and answers the research question RQ2: what situational factors do users perceive to be salient 
when they make requests of human intermediaries? Four dimensions of information needs including user goals, 
types of information sought, perceived importance of obtaining information, and user biases in information 
needs, as well as the modification of information needs, are described with patterns of association among 
them. Three factors associated with the generation of users’ IPS goals are described and discussed with their 
relation to time pressure and participants’ freedom in IPS processes. These factors are compared with artifacts 
developments in order to identify relationships between them. Two variables of social functions, namely 
"capacity" and "role" in IPS are discussed with their relationship with participants’ IPS goals. Relations between 
"role" and information sharing are analyzed in order to identify patterns of associations between them. 

INFORMATION NEEDS 

Information needs are considered as the major motivational thrust in generating human information behavior 
(Wilson, 1981, 1999; Dervin & Nilan, 1986, Taylor, 1986; Marchionini, 1995). In this study, information needs 
are considered to be situational in two ways: (1) different information needs generate different requests; (2) 
information needs may be modified during an IPS process (Taylor, 1962, 1968; Belkin & Oddy, 1982a, 1982b; 
Spink & Greisdorf, 1998; Wilson, 1999; Xie, 1997). Thus, it should be important to identify major characteristics 
of information needs that were associated with participants’ uses of the AskERIC Q&A Service. 

This section describes four dimensions of information needs. They are: (1) user goals, (2) types of information 
sought, (3) perceived importance of obtaining information, and (4) user biases in information needs. 
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In the following, four dimension of information needs will be elaborated on and described with patterns of 
associations observed within the dimension and between dimensions. User goals will be described on multiple 
levels in an effort to integrate the goal model of Bandura’s (1989) social cognitive theory into the IPS processes. 
The factor of type of information sought will be compared with user goals. Perceived importance of obtaining 
the information will be related to reasons for importance. The factor of user biases in information needs will 
be compared with user goals. Patterns of modifications in information needs during participants’ IPS processes 
are also reported, 

MULTIPLE LEVELS OF USER GOALS 

During the preliminary analysis of the interview data (inter-category integration), I noticed that participants 
articulated their goals in multiple levels. This recognition fits well with Bandura’s (1989) goal model in his 
social cognitive theory that makes a distinction between distal goals and proximal subgoals in which the former 
"serve as general directive function" and the latter "determine people’s immediate choice of activities (p. 473- 
474). Also the tasks some participants requested of the AskERIC Q&A Service seemed to be a whole or a part 
of what they intended to accomplish through the use of the service. This recognition suggested that the analysis 
of user goals be done at multiple levels and a comparison of the lower-level goals with tasks requested of 
AskERIC might provide a better understanding of relationships between participants’ information needs and 
tasks they requested of AskERIC. 

Based on the above, this study operationally defined user goals on the following three levels: * 

(1) Goals of using the AskERIC Q&A Service: what participants intended to accomplish through 
the use of The AskERIC Q&A Service; 

(2) IPS goals: what participants intended to accomplish through the IPS process; and 

(3) Higher-level goals: what participants intended to accomplish by fulfilling IPS goals. 

Each participant's goals were extracted and categorized into three levels defined above. For example, participant 
P5 was looking for possible places that would give grants (goal of using AskERIC) in order to write and submit 
the grant proposal (IPS goal) so as to be able to get grant funded (higher-level goat). Summaries of descriptions 
of each level of goals of the individual participant are presented in Appendix Cl. I further compared these 
descriptions of user goals between participants in order to find patterns among them. The result is presented 
in Table 6-1. In this table, participants’ IPS goals are grouped into eight broad categories. Similar goals of using 
the AskERIC Q&A Service are grouped together and listed under each of the IPS goals with participant ID 
numbers. 
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Table 6-1: Participants’ Goals in Multiple Levels (N=62) 



IPS Goal Category 


IPS Goal 


Goal of Using The AskERIC Q&A Service 


Participant ID 


DEGREE SEEKING: 


A Conduct research and/or 


a Decide topic of research/paper 


P41 P50 P53 


attain a degree, fulfill 
course requirements, 
get good grade. 


write paper/thesis as a 

course/degree 

requirement. 


b Find/obtain sources of information 
relevant to the topic of class assignment 


P2P13P27P35 P45 P47 
P51 P55 P59 P62 P65 


c Obtain known ERIC documents 


P25P36P42P48P49 






d Identify ED number of an ERIC digest to 
use it in citation. 


P9 






e Find statistical formula/data to used it in 
designing research 


P11 PI 2 




B Develop a lesson plan as 
a course requirement. 


Find/obtain lesson plans developed by 
others 


P58 




C Do reading assignment 
for a class. 


Locate/obtain known sources 


P29 




Common goals 


Test the AskERIC Q&A Service 


PI 2 P33 P42 P43 P53P58 
P59 






Learn how to use The AskERIC Q&A 
Service to find information 


P18P33P49 






Verify own search process/result 


P23 P43 P48 


DECISION/ACTION 
PLANNING: make 
own decision or 


A Enhance own Knowledge 
to be able to make 
decision or to take action. 


Find/obtain sources of information relevant 
to the topic of decision/actin. 


PI P4P6P7P10P17P19 
P20 


influence/ protest 
others’ decision. 


B Respond to or convince 
stakeholders. 


Find factual data that support/ invalidate a 
decision/ action 


P8 P24 P26 P28 P52 P57 
P60P64 




C Influence/protest 
decision/action of others. 


Get experts’ opinions on a decision/action 


PI 5; P22; P34 




Common goals 


Test the AskERIC Q&A Service 


P7 P15P17P22P28 






Verifv own search Drocess/result 


P60 


TEACHING: be 
prepared to teach 
classes, help 


A Design a lesson plan by 
incorporating existing 
lesson plans or ideas. 


Find/obtain lesson plans developed by 
others 


P21 ; P32; P46; P63 


students learn. 


B Design or select materials 


a Find/obtain teaching materials 


PI 6; P31 




to prepare for courses. 


b Get permission to use sources as 
teaching materials 


P38 




Common goals 


Test the AskERIC Q&A Service 


P16P31 






Leam how to use system/service 


P21 


MARKETING: sell 
products. 


A Send promotional materi- 
als to potential customers. 


a Find/obtain data on potential customers 


P3;P5 




B Find potential sales 
channels 


b Rnd Internet sites to promote a book 


P56 




Common goal 


Test the AskERIC Q&A Service 


P54 P56 




Write/submit grant proposal. 


Find potential sources of grant 


P5 


CAREER ENHANCING: 
get recruited 


Prepare for job interview. 


Find/obtain sources of information 
(background for discussion) 


PI 4 




Common aoal . 


Test the AskERIC Q&A Service 


P14 


RESEARCH: conduct 
research & publish it 


Write report/ hold workshop 


Find/obtain sources of information relevant 
to the topic of research. 


P30 


PRESENTATION: do a 


Prepare for a presentation. 


Rnd facts appeal to the audience 


P44 


presentation 


Common goal 


Test the AskERIC Q&A Service 


P44 
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As shown in Table 6-1, some goals of using the AskERIC Q&A Service are unique to a particular category of 
IPS goal, while some goals of using the service are common among multiple categories of IPS goals that are 
shown in italics in the table. For example, goals of "deciding a topic of research/pa per" and "obtaining known 
documents" are identified only under the DEGREE SEEKING goal. Similarly, goals of "find factual data that 
support/invalidate a decision/action" and "get experts’ opinions on a decision/action" are identified only under 
the DECISION/ACTION PLANNING goal. Thus, these goals are considered as unique to each category. 

On the other hand, three goals of using the AskERIC Q&A Service are identified as common goals: 

(1) Test the AskERIC Q&A Service, 

(2) Learn how to use the system/service, and 

(3) Verify own search process/result. 

Further analysis of interview data identified that (1) test the AskERIC Q&A Service was unique to those participants 
who had no experience of using the service, (2) learn bow to use the system/service was unique to those 
participants who had a low level of perceived IPS skill, and (3) verify own search process/result was unique 
to those who did self-searching before sending requests, had experience in using the service, and had a high 
level of perceived IPS skill. Details of these findings will be reported later. 

TYPE OF INFORMATION SOUGHT 

Participants articulated during the interview what type of information they were looking for when they made 
requests of the AskERIC Q&A Service. In many cases, however, participants described the types of information 
they sought as compared to what they received from AskERIC, in response to interview question Q19 1 - The 
type of information a participant sought did not always coincide with the type of information they requested 2 . 
For example, participant P9 requested a known ERIC digest, but what she wanted was the ED number of the 
digest that she intended to use as a part of a citation of a paper. The contradiction between what users wanted 
and what they requested of librarians is a widely recognized phenomenon in traditional library reference 
services in face-to-face settings (Taylor, 1962, 1968; Edmonds & Sutton, 1991; Michell & Dewdney, 1998). The 
above finding suggests that the same phenomenon can be observed among users of the AskERIC Q&A 
Service - a digital reference service (DRS). 

The types of information participants were actually looking for were categorized into seven groups and 
compared with the three categories of IPS goal (Table 6-2). 



1 1nterview question 019 asked, “Please describe to me what you received from AskERIC." Probe question used to elicit what they wanted was, "Was it what you 
requested?" [If answer is negative, ask] "Why?" 

2 The data instances are provided in Appendix D4. 
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Table 6-2: Types of Information Sou; 


jht and IPS Goal Category (N=62) 


Type of Information Sought 


IPS Goal Category 


DEGREE SEEKING 


DECISION/ACTION PLANNING 


TEACHING 


Other* 


Total 


Source (website, databases, journal 
articles, books, research reports, 
organizations, ERIC documents) 


21(75.0%) 


6(30.0%) 


2(28.6%) 


4 (57.1 %) 


33 (53.2 %) 


Fact (time frame, procedure, inter- 
pretation of law, concrete evidence, 
definition of terms) 


0 


9(45.0%) 


1 (14.3%) 


2 (28.6 %) 


12(19.4%) 


Data (statistical data (statistics, 
formula,), metadata of documents) 


3(10.7%) 


2(10.0%) 


0 


1 (14.3%) 


6 (9.7 %) 


Lesson Plan 


1 (0.4 %) 


0 


4 (57.1%) 


0 


5 (8.1 %) 


Anything (any type of information 
on the topic) 


3(10.7%) 


0 


0 


0 


3 (4.8 %) 


Expert opinion 


0 


2(10.0%) 


0 


0 


2 (3.2 %) 


Contents (contents of documents) 


0 


1 (5.0 %) 


0 


0 


1 (1.6%) 


Total 


28 (100.0 %) 


20 (100.0 %) 


7(100.0%) 


7(100.0%) 


62 (100.0 %) 



"Other" category of goal includes marketing, grant seeking, career enhancing, presentation, and research. 



As shown in Table 6-2, the following patterns of associations are observed in the types of information sought 
and the three IPS goal categories: 

• Participants with a DEGREE-SEEKING goal tended to look for sources such as articles, books, and 
ERIC documents in order to write papers or the literature review of thesis. 

• Participants with the DECISION/ACTION PLANNING goal tended to look for facts and sources to 
be used as evidence in order to support/reject a decision/action. 

• Participants with the TEACHING goal tended to seek lesson plans and teaching materials. K-12 
teachers tended to look for lesson plans to be used in designing their own lessons, and 
college/university faculty members tended to look for sources to be used as teaching materials. 

Based on the above, participants' IPS goals tend to be associated with the types of information they sought. 

INTENSITY OF INFORMATION NEEDS 

In response to Q6 of the telephone interview 3 , all 62 participants provided their perceived level of importance 
of obtaining the information they were looking for on a scale of 1 to 10 with 1 as least important, 5 as average, 



3 The question 06 of the telephone interview asked, "With 1 as least important, 5 as average, and 1 0 as very important, how important was it for you to find the information 
you were looking for?" 
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Table 6-3: Importance of Finding Information and Reasons (N=62) 



Reasons 


Score 


1 


2 


3 


B 


5 


6 


B 


8 


9 


10 


Median 


Goal- 

related 

Reasons 


Goal is important 




















12 


10 


The information is critical 
for attaining the goal 


■ 


■ 


■ 


B 


fl 


B 


1 


1 


B 


11 

j 


10 


Need to do comprehensive 
literature review 


■ 


■ 


■ 


B 


B 


B 


B 


B 


B 


1 


10 


Best way to attain the goal 




















2 


10 


Need to dispute 




















1 


10 


Class/course requirement 
















1 


1 


1 


9 


Information makes it easier 
to achieve the goal 


■ 


■ 


■ 


■ 


■ 


■ 


■ 


i 


B 


fl 


8 


Information helps make 
own argument 


■ 


■ 


■ 


■ 


■ 


B 


B 


1 


B 


B 


8 




Information is supplementary 
for achieving the goal 


■ 


■ 


■ 


B 


B 


2 


2 


1 


■ 


B 


6 


Background information 














1 








7 


Time- 

related 

Reasons 


Time pressure 




















1 


10 


Time saving 




















1 


10 


Personal deadline 


















1 




9 


Not immediately pressing 












1 










6 


IPS 

process- 

related 

Reasons 


Exhausted sources 














1 






3 


10 


Initial trial 














1 


. 1 






7.5 


Need a comprehensive search i 




















1 


10 


Alternative sources are 
available to find information 


■ 


■ 


■ 


■ 


■ 


■ 


1 


1 


■ 


B 


■ 


Logistic information 












1 










6 


No intention to use 
information 


r 


■ 


■ 


■ 


■ 


B 


B 


B 


B 


■ 


1 


Job-related 

Reasons 


New to the job 




















1 


10 


Job responsibility 














1 






i 


8.5 


Personal 

Reasons 


Personally interested 


■ 


■ 


■ 


B 


fl 


fl 


fl 


3 


B 


1 


8 


Other 

Reasons 


Need accurate information 


















1 




9 


Question need to be answered 




















1 


10 


Decision/action should be 
research-based 


■ 


■ 


■ 


■ 


fl 


■ 


B 


fl 


1 


B 


9 


No specific reason 












1 










6 



* The participant gave score of "0" but I interpreted as 1 , because that Is the lowest score available in the instrument. 



and 10 as very important. Most of the participants articulated their reasons for reporting a specific score either 
voluntarily or by responding to a probe question (i.e., "Why?"). Similar reasons were grouped together and 
compared with the score of importance. The result is presented in Table 6-3- 
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Some participants gave multiple reasons for giving a particular score. Thus, these reasons are not mutually 
exclusive. Even though it was assumed that the same score provided by different participants did not necessarily 
refer to the same level of importance, the distribution of reasons and median scores of each reason imply the 
following: 

• Goal-related reasons: A great majority of participants (44 or 71.0 %) gave reasons for providing 
a particular score as related to their IPS goals. Participants tended to perceive it to be very important 
to obtain the information when they thought the IPS goal was important and the information was 
critical to attain the goal. On the other hand, participants tended to perceive it to be not very 
important when the information they sought was supplemental to attain the goal. 

• Time-related reasons: Four participants (6.5 %) gave time-related reasons for providing a particular 
score. Participants tended to perceive it to be important to obtain the information when they were 
under time pressure and wanted to save time. However, they tended to perceive it to be not very 
important when the information was not immediately needed. 

• IPS process-related reasons: Eleven participants (17.8 %) gave reasons related to their IPS 
processes. Participants tended to perceive it to be very important to obtain the information they 
sought when they had exhausted available sources. However, they tended to perceive it to be not 
very important when their use of the AskERIC Q&A Service was the initial step to look for the 
information, and when they knew that alternative sources were available. 



Based on the above, the perceived importance of Finding information tends to be associated with IPS goals, 
time concerns, and IPS processes. For instance, one participant who was asked by her instructor to send a 
request to AskERIC using an impromptu information need during a class lab session said it was not at all 
important for her to obtain the information and gave a score of one 4 , because she herself had no intention of 
using that information. Another participant in a similar setting said it was very important for her to obtain the 
information and gave it a score of 10, because she was required to submit the AskERIC response to the instructor 
as a basis for her grade. These two contrasting cases suggest that the existence and/or importance of higher- 
level goals tend to be associated with the user’s perceived level of importance in obtaining the information. 



4 The participants gave the score "zero" but I interpret it as "one” which is the lowest score available in the scale. 
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PRETENDED RATIONALITY - 

A SOURCE OF USER BIASES IN INFORMATION NEEDS 

This research identified inherent biases in seven participants’ information needs. They had anchored their 
opinions on the problems or issues of their interests before they made requests of the AskERIC Q&A Service 
and sought only those pieces of information (facts, research findings, and/or experts’ opinions) that supported 
their contentions 5 . 

I named the motivation behind such biased information needs as "pretended rationality,” in which participants 
tried to find information that supports their opinions. This is because they considered research-based information 
a powerful weapon that would help persuade other people who had different opinions and consequently 
exert influence on decisions and/or actions. However, the opinions themselves were not necessarily rational 
because they were not based on research findings. In other words, participants developed their opinions or 
made decisions based on personal merits or other subjective reasons, but pretended as if their opinion were 
rational by using research findings or experts’ opinions as supporting evidence. 

Among seven participants who made requests based on biased information needs, six were identified as having 
the DECISION/ACTION PLANNING goal. Thus, biases in information needs and "pretended rationality" behind 
them seem to be a peculiar characteristic of IPS for the DECISION/ACTION PLANNING goal. 

MODIFICATION OF INFORMATION NEEDS 

This study captured modification in different aspects of information needs in 23 participants’ IPS processes. 
Through constant comparative analysis of interview data, the study identified following patterns of modifications 
on different levels of user goals. 

• Change of user goals on both levels at the time of encountering the AskERIC Q&A Service in self- 
searching on the Internet (deactivation of current IPS goals and activation of new IPS goals). 

• Addition of new IPS goals at the time of receiving partially relevant information from AskERIC 
(activation of new IPS goals in addition to current IPS goals). 

• Abandonment of the immediate sub-goals and generation of new sub-goals in order to fulfill imposed 
IPS goals. 

• Abandonment or deactivation of both immediate and IPS goals at the time when users receive 
irrelevant or null information from AskERIC. 



5 Examples of data instances are provided in Appendix D5. 
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Modifications were also identified on aspects of information needs: 

• Change in topic of the search when users cannot find enough information on the current topic in 
self-searching or by using the AskERIC Q&A Service. 

• Change in the type of information needed (e.g., aggregated statistical data => data from small-scale 
case studies; abstracts of research papers => experts’ opinions) at the time when they received 
irrelevant, null, or overwhelming amount of information from AskERIC. 

• Increase in focus of information needs through self-searching and/or browsing information obtained 
from AskERIC. 

• Increase in intensity of information needs through self-searching. 

• Change in strategy (e.g., format of reference in a paper, statistical procedure to be used in research, 
strategy to obtain fulltext documents, use existing lesson plans -> develop new lesson plans, etc.) 
as a result of unsuccessful self-searching and/or irrelevant or null information obtained from AskERIC. 

Researchers in user-based IR and IPS research have assumed that users’ information needs might be modified 
through IR interaction, and their findings and models captured some such modifications (Oddy, 1977; Xie, 1997). 
However, none of them provide a clear definition of "modification of information needs." In addition, existing 
findings or models concerning "modification of information needs" have yet to capture a variety of patterns of 
modifications as exemplified above. Incorporation of the concept of multiple levels of goals of Bandura’s (1986) 
goal model of social cognitive theory enabled this research to take a step forward to fill that gap. 

It should be noted that in many instances participants modified their goals or information needs, they tended 
to take the easier path from among available alternatives. For example, participants who were looking for a 
topic for a paper tended to choose an easier topic in terms of availability of relevant sources. Similarly, a 
participant who was looking for a statistical formula changed statistical methods to a familiar one so as to be 
able to finish writing a research proposal. In that sense, these findings support Poole’s (1985) "least effort 
principle" operating in IPS processes. 

GENERATION OF IPS GOAL 

Provided that human IPS activities are goal-oriented, IPS processes themselves can be considered as structured 
by the user goals. At the same time, processes by how such goals were generated may also be associated with 
participants’ IPS behavior. Based on this premise, this research pursued situational factors associated with 
generation of participants’ IPS goals. 
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FACTORS ASSOCIATED WITH GENERATION OF INFORMATION NEEDS 

Three factors were identified as associated with the generation of participant s’ IPS goals. They are: (1) imposition, 
(2) social influence , and (3) personal interests. This section first discusses these three goal-generating factors 
and how they were associated with participants’ IPS goals. Then, findings of associations between these factors 
and other situational factors are described. 

Imposition of User Goals 

Gross (1995) proposed that IPS behavior would be different when "people are seeking information not because 
they have identified an information need themselves, but because they have been set on that course by 
another," and called this situation an "imposed query" (p. 236). 

In this study, imposition was identified on three levels: 

• Imposition of IPS goal: A majority of participants (43 or 72.6 %) were given the IPS goals by other 
people. For example, participants whose capacity was college or university students were given 
class assignments (e.g., a paper, research, a presentation, a reading assignment, etc.) by the instructor 
or were required to write a thesis in order to attain a degree or course credit. Others were required 
to conduct IPS activities by the boss and/or as their job assignments. 

• Imposition of information source: Three participants (4.8 %) were required by the instructor to 
use the AskERIC Q&A Service as a <class/course assignment. Among them, two were requested by 
the instructor to send requests to AskERIC during a class (lab), and one was required to write a 
term paper by using the AskERIC Q&A Service to find information. In addition, two participants 
were required by the instructor to use the ERIC database on the AskERIC website to find information 
for class assignments arid ended up using the Q&A Service. 

• Imposition of the topic of IPS: Two participants whose capacity was student sent requests on 
the topic prepared by the instructor. 

All together, a great majority of participants (46 or 74.2 %) had their goals imposed on one or more of these 
three levels. 

Social Influences in Generating User Goal 

Even when participants reported they generated their information needs by themselves, some of them had 
IPS goals influenced by other people. For example, one participant made a request of AskERIC concerning 
the approximate time interval between submission of a written request and physical assessment of the 
individualized education program (IEP) in order to help a mother of a severely disabled child in her support 
group voluntarily. Another participant, a high school teacher, sought research-based evidence that supports 
her contention that the late school starting time was detrimental to high school students in order to exert 
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influence on the county’s decision to change the school starting time. Her IPS goal was generated by influences 
of the county’s plan as well as by other teachers, because she said she started searching for the information 
when she heard a rumor from other teachers in her school that opponents obtained research-based evidence 
to support their contention 6 . All in all, seven participants’ (11.3 %) were identified as their IPS goals generated 
by social influence \ 

Personal Interests in Generating User Goal 

Nine participants (14.5 %) were identified as seeking information based on self-generated IPS goals that were 
free from imposition and/or other people’s influence. For example, one participant who recently had been 
diagnosed as dissociated identity disorder (DID) made a request of AskERIC for information about the relation 
between DID and learning disability (LD) so as to understand more about her own learning problems for the 
purpose of waiving math requirements. Another participant made a request on an appropriate procedure to 
clean a baby’s ears, as well as the reason why Q-tips should not be used, in order to make sure that he was 
not damaging his daughter’s well being 7 . 

In a sense, imposition can be considered as a special type of social influence, because human imposers 
determine users’ IPS goals. Thus, the above findings indicate that only nine or 14.5 % of participants’ goals 
were cognitively generated by the participants' own interests. Thus, a relatively small number of participants 
had internally generated goals. This finding indicates the significance of social situations in human IPS behavior. 

GOAL-GENERATING FACTORS AND GOAL TYPE 

Table 6-4 presents association between three categories of IPS goal and three goal-generation factors . 

As shown in Table 6-4, all participants with either the DEGREE SEEKING goal or the TEACHING goal had 
their goal imposed. Participants whose capacity was student had their IPS goals imposed by instructors or 



Table 6-4: Association between Goal-Generating Factors and IPS Goal Category (N=62) 



IPS Goal Category 


Goal-Generating Factor 


Imposition 


Social Influence 


Personal Interest 


Total 


DEGREE SEEKING 


28(100.0%) 


0 


0 


28 (100.0 %) 


DECISION/ACTION PLANNING 


6(30.0%) 


8(40.0%) 


6(30.0%) 


20 (100.0 %) 


TEACHING 


7(100.0%) 


"o 


0 


7 (100.0 %) 


Other 


4 (57.1 %) 


0 


3 (42.9 %) 


7 (100.0 %) 


Total 


45 (72.5 %) 


8(12.9%) 


9(14.5%) 


62 (100.0 %) 



6 Examples of data instances are provided in Appendix D6 



Examples of data instances are provided in Appendix D7. 
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academic programs that offer degrees. Participants whose capacity was K-12 teacher or college/university 
faculty member were required by their job assignments to teach particular classes and/or courses. Hence their 
IPS goals of preparing for these courses are imposed. Some participants are required by their boss and/or job 
responsibility to prepare for particular decisions/actions. All six participants with imposed DECISION/ACTION 
PLANNING goals identified themselves as collaborators on the IPS projects. They reported that other members 
who took part in the collaborated IPS processes imposed their IPS goals on them. 

Social influence , on the other hand, seems to be a unique factor for the DECISION/ACTION PLANNING goal. 
Participants with this IPS goal were voluntarily involved in decision/ action-planning activities by experiencing 
social influence from other people or organizational bodies, and pursued their IPS goals in order to protect 
their own job territories or shared interests of groups to which they belonged. 

Personal interest also seems to be a unique factor that generated the DECISION/ACTION PLANNING goal. 
Different from those who had a socially generated DECISION/ACTION PLANNING goal, participants' decision 
and/or action were concerned with their personal/family problems. 

IMPOSITION OF IPS GOAL AND DEADLINE 

Table 6-5 presents three goal-generating factors and the deadline of IPS processes. 



Table 6-5: Association between Goal-Generating Factors and Deadline (N=62) 



Goal-generating Factor 


Deac 


lline 


Imposed deadline 


Self-set deadline 


No deadline 


Total 


Imposition 
Social influence 
Personal interests' 
Total 


33(73.3%) 
2 (25.0) 

1 (11.1 %) 

36 (58.1 %) 


3 (6.7 %) 

1 (12.5%) 

2 (22.2 %) 
6 (9.7 %) 


9 (20.0 %) 

5(62.5%) 

6(66.7%) 

20(32.3%) 


45(100.0%) 

8(100.0%) 

9(100.0%) 

62(100.0%) 



As shown in Table 6-5, 33 or 73 3 % of participants whose IPS goals were imposed also had an imposed 
deadline, while the majority of participants who had goals generated by social influences and/or personal 
interests did not have any deadline for their IPS. This finding suggests that there is an association between 
imposition of IPS goals and a deadline \ Deadlines were found to be associated with perceived time pressure , 
and perceived time pressure was also found to be associated with negative emotion (e.g., frustration) in self- 
searching (see Chapter 7 under "Time Factors in Self-Searching"). Thus, the data suggest that the imposition 
of IPS goals should have a significant impact on human IPS processes. 
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GOAL-GENERATING FACTORS AND DEVELOPMENT OF ARTIFACTS 

Participants took different avenues depending upon what they received (or did not receive) from AskERIC, 
as well as what they found in other information sources. Many participants who obtained required information 
to complete their IPS goals by the time of the interview used or planned to use the information in developing 
artifacts. On the other hand, participants with IPS goals generated by their own interests seem to have completed 
their IPS goals at the time when they obtained relevant information from AskERIC or any other sources. 

Forty-four participants (71.0 %) developed or planned to develop artifacts based on what they found in their 
IPS processes. Table 6-6 presents types of artifacts they developed or planned to develop. 



Table 6-6: Type of Artifacts Developed (N=62) 



Type of Artifact 


Status of Artifacts Development 




Planed 


Total 


Paper/thesis/report 


8 


17 


25(40.3%) 


Lesson plan 


4 


1 


5 (8.1 %) 


Presentation/seminar 


1 


3 


4 (6.5 %) 


Other* 


8 


2 


10(16.1 %) 


None 


18 


18(29.0%) 


Total 




62 (100.0%) 



* ’Other’ category includes course pack (1); grant proposal (1); letter (1); library handbook (1); list of websites (1); mailing list (1); spreadsheet (1); syllabus (1); a 
package (1); and search result (1) 



The participants’ goal-generating factors were compared with whether they developed (or planned to develop) 
artifacts. The result is presented in Table 6-7. 



Table 6-7: Association Between Goal Generating Factors and Artifact Development (N=62) 



Goal Generating Factor 


Artifact Development 


Yes 


No 


Total | 


Imposition 




5(11.1 %) 




Social Influence 


3(37.5%) 


5 (62.5 %) 


■■KvnrsTSisi^H 


Personal Interest 


1 (11.1 %) 


8 (8.8.9%) 




Total 


4471.0%) 


18(29.0%) 


62(100.0%) 



As shown in Table 6-7, participants with imposed IPS goals tended to develop artifacts, as suggested by Gross 
(1995). On the other hand, participants with IPS goals generated by social influence and personal interests 
tended not to develop any artifacts. 
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GOAL-GENERATING FACTORS AND STABILITY OF IPS PROCESS 

Three goal-generating factors discussed above seem to be associated with the stability of IPS processes. This 
section discusses relationship between goal-generating factors and degree of freedom participants had in IPS 
processes as well as modifications in multiple levels of goals. 

Goal-Generating Factors and Degree of Freedom in IPS Processes 

The imposition of IPS goals seems to have limited the amount of control participants maintained in their IPS 
processes. When participants had imposed IPS goals, they still maintained the freedom of choosing information 
sources/channels, selecting the topic of the search within the limitation of the domain or scope of the class 
they were taking/teaching and of the job assignment. But they were also likely to have an imposed deadline 
for the IPS, which may be associated with perceived time-pressure and frustration during the IPS process. When 
the use of particular sources (e.g., ERIC database, the AskERIC Q&A Service, etc.) for the IPS was imposed, 
participants would have no choice in selecting information sources/channels, but still would maintain freedom 
of choosing a topic of the search. When both the IPS goal and the topic were imposed, participants would 
not have much freedom in the IPS processes even though they might have freedom in selecting information 
sources/channels. When imposition was made on all three levels, the participants would hardly maintain any 
freedom in the IPS processes. Thus, the imposition of any level would decrease the degree of freedom 
participants had in their IPS processes to a greater or lesser extent. 

Social influence on the IPS goals also seems to have limited participants’ freedom in their IPS processes. When 
participants had socially generated IPS goals, such as resolving conflicts, influencing other parties’ decisions, 
or planning cooperative actions, these goals may have limited the topic of the search. In addition, socially 
generated IPS goals may also have been accompanied with an imposed deadline , particularly when social 
contexts involved collaborative decision-making or action-taking. 

Only those participants who had internally generated IPS goals of fulfilling personal interests or family-related 
problem-solving/action-planning would have a high degree of freedom in their IPS processes, since they had 
complete freedom of choices of topic and sources/channels and generally did not have any imposed deadline. 

As reported above, a great majority of participants of this study had their IPS goals either imposed or socially 
generated. Thus, the findings of this study should reflea the limited degree of freedom they had in their IPS 
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Goal-Generating Factors and Modification of User Goals 

The limitation of the degree of freedom participants had in their IPS processes seems to be directly related to 
the possible modifications they made on their IPS goals. Through constant comparative analysis of interview 
data, the study identified the following patterns of relationships between goal-generating factors and 
modification of participants’ goals. 

• Five participants who had imposed IPS goals with a very close deadline (within a week from making 
the requests) abandoned their initial goal of using the AskERIC Q&A Service at the time when they 
received null or irrelevant information from AskERIC. They used information at hand or own 
knowledge to accomplish their IPS goals in time. 

• Six participants who had imposed IPS goals with relatively distant deadline (one month or more 
from making the requests) modified their initial goal of using the AskERIC Q&A Service together 
with other dimensions of information needs, such as topic of the search or type of information 
sought, at the time when they received irrelevant or partially relevant information from AskERIC. 
They continued searching for information by making new requests to AskERIC or by self-searching 
of other sources in order to complete their IPS processes. One of them added a new IPS goal when 
he received information partially relevant to the initial information needs but included sources useful 
for the newly activated IPS goal. 

• Two participants who had IPS goals generated by personal interests and had no imposed deadline 
abandoned or deactivated their IPS goals when they received irrelevant information from AskERIC. 

One of them reported that she obtained needed information at a later time unexpectedly. 

• Three participants who encountered the AskERIC Q&A Service switched their IPS goals and made 
requests of AskERIC based on suddenly activated information needs for different IPS goals. 

Patterns of modification of user goals described above imply that the stability of IPS goals is related to goal- 
generating factors in the following ways: 

• Users with imposed IPS goals are likely to maintain them by modifying or abandoning lower level 
immediate goals. 

• Users with personally generated IPS goals are likely to abandon or deactivate their IPS goals when 
relevant information is not available easily. 

• Abandoned personally generated IPS goals may be activated when users encounter relevant 
information unexpectedly. 

Above findings suggests that imposition and social influence in generating user goals are closely related to 
modification of user goals or information needs. 
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SOCIAL FUNCTION IN IPS PROCESS 

Two variables of social functions, capacity and role in a particular IPS process, were identified as associated 
with participants’ IPS goals. Assuming that one person may take several different functions in everyday life - 
a teacher, a student, a parent - at a different time for a different task, Q30 8 of the telephone interview elicited 
each participant’s capacity for the particular IPS process that generated the particular requests captured in the 
study. Participants’ roles , on the other hand, were defined based on whether they were originator ; collaborator ; 
or proxy in the IPS process, and were elicited by interview question Q2 9 . This section describes associations 
identified between participants’ IPS goals and their capacity and role. 

CAPACITY IN IPS PROCESS 

Table 6-8 compares participants’ primary occupation with their capacity in the IPS processes captured in the study. 



Table 6-8: Occupation and Capacity (N=62) 



Primary Occupation 


Capacity in II 


5 S Process 


K-12 teacher 


Faculty 


Admin./Manager 


Librarian 


Student 


Parent 


Other** 


Total 


K-1 2 teacher 


7 (33.3 %) 








13(61.9%) 


1 (4.8 %) 




21 (100.0%) 


Faculty 




EiEarasi 












— 


AdminVmanager 






5 (50.0 %) 




4 (40.0 %) 


1 (10.0%) 




10(100.0%) 


Librarian 








asms] 






CTSaETSf 




Student 












IMsft®] 




BHE— 


Home-maker 












1 (100.0%) 




1.(100.0%) 


Other* 










3(21.3%) 


4(28.6%) 


7(50.0%) 


BH 


Total 


7(11.3%) 


4(6.5%) 


5 (8.1 %) 


2 (3.2 %) 


28 (45.2 %) 


8(12.9%) 


8(12.9%) 


62(100.0%) 



•Other primary occupations include: registered nurse, technical editor, occupational therapist, video-tape editor, urban planner, real-estate agent, telephone representative, 
speech language pathologist, instructional technology assistant, self-employed scrap metallurgist, process consultant, school counselor, school psychologist, and retail 
sales person. 

**0ther capacities include: reading consultant, editor, speech language pathologist, instructional technology assistant school counselor, and a person in the process of 
career change. 

As shown in Table 6-8, almost a half of the participants made requests of the AskERIC Q&A Service as a student 
regardless of their primary occupations - a majority of K-12 teachers, almost a half of the administrators, and some 
college/university faculty members acted as a student in the IPS process. It should be noted that when participants 
were asked their occupation at first 10 , they reported their primary occupation. They declared that they also were 
students only after they were asked their capacity for the particular request. This finding implies that clients of the 
AskERIC Q&A Service are more likely to make requests as students regardless of their primary occupation. 



Participants’ capacity was compared with their IPS goals, and the result is presented in Table 6-9- 



8 Interview question 030 asked: "In what capacity did you request information from AskERIC?" 

* Interview question 02 asked: "Is the request for information your own or that of someone else?" 
,0 Interview question 028 asked: "What is your occupation®?” 
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Table 6-9: Capacity and IPS Goal (N=62) 



Capacity in IPS Process 


IPS Goal Category 


DEGREE SEEKING 


DECISION/ACTION PLANNING 


TEACHING 


Other 


Total 


K-12 teacher 


0 


3 (42.9 %) 




0 




Faculty 


0 


0 


2 (50.0 %) 


2(50.0%) 


4(100.0%) 




0 




0 






Librarian 


0 




0 






Student 




0 


0 


0 


KEUBTiTitBl 


Parent 


0 


8 ( 100 . 0 %) 


0 


0 


B— 


Other 


0 


5 (62.5 %) 






KKI 


Total 


28 (45.2 %) 


20 32.3%) 


7(11.3%) 


7(11.3%) 


62 (100.0%) 



As shown in Table 6-9, there seem to be the following patterns of associations between participants’ capacity 
and their IPS goals. 

• All participants who acted as a student had a degree-seeking goal, 

• All participants who acted as a parent had a decision/action-planning goal, 

• A majority of participants who acted as a K-12 teacher had a teaching goal, and 

• A majority of participants who acted as an administrator/manager had a decision/action-planning goal. 



The above findings suggest that participants’ capacity in their IPS processes is highly associated with their IPS goals. 

ROLE IN IPS PROCESS 

Participants’ role in the IPS processes was categorized into three groups: (1) an originator who made requests 
of AskERlC based on his/her own information need, (2) a collaboratorvsho made request for a joint EPS project 
in which s/he was taking a part, and (3) a proxy who made requests representing other persons. Associations 
among participants’ role and IPS goal category, as well as their information sharing behavior are analyzed. 



Association between Rote and IPS Goat 

IPS goal category was compared with their role in the IPS processes (Table 6- 10). 



Table 6-10: Role and IPS Goal Category (N=62) 



IPS goal category 




Role in IPS Process 


Originator 


Collaborator 


Proxy 


Other 


Total 


Degree-seeking 


26(92.9%) 


0 


0 


2 (7.1 %) 


28(100.0%) 


Decision/action-planning 


14(70.0%) 


5(25.0%) 


1 (5.0 %) 


0 


20(100.0%) 


Teaching 


6 (85.7 %) 


1(14.3%) 


0 


0 


7(100.0%) 


Other 


5(71.4%) 


2(28.6%) 


0 


0 


7(100.0%) 


Total 


51 (82.3%) 


8(12.9%) 


1 (1.6%) 


2(32.3%) 


62(100.0%) 
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As shown in 6-10, a great majority of participants of the study identified themselves as an originator , while a 
little more than 10% as a collaborator ; and only one as a proxy. There seem to be the following associations 
between participants' IPS goal and their role in the IPS process: 

• Participants with a DEGREE SEEKING goal tend to perceive themselves as acting as an originator. 
However, two participants who were compelled to use the AskERIC Q&A Service for in-class 
assignments identified themselves as "other." 

• Participants with a TEACHING goal tend to perceive themselves as acting as an originator However, 
a participant who supported students' presentation as an instructional technology assistant identified 
herself as a collaborator. 

• While a majority of participants with a DECISION/ACTION PLANNING goal identified themselves 
as an originator ; about a quarter reported themselves as a collaborator. All five who were acting 
as a collaborator were involved in socially generated IPS goals of decision/action-planning. 

The above findings might imply that IPS processes for socially generated DECISION/ACTION PLANNING goal 
tended to involve multiple people in information problem solving. 

Eighteen participants (29 0 %) indicated that they shared or planned to share information they obtained from 
AskERIC and/or other sources. Table 6-11 presents the association between participants' role in the IPS process 
and whether they shared information with other people. 



Table 6-11: Role in IPS and Information Sharing (N=62) 



Role in IPS 


Share Information 


Unknown 


Total 


Originator 


11 (21.6%) 


40 (78.4 %) 


51 (100.0 %) 


Collaborator 


7 (87.5 %) 


1 (12.5%) 


8(100.0%) 


Proxy 


1(100.6%) 


0 


1 (100.0%) 


Other* 


0 


2(100.0%) 


3(100.0%) 



* Participants in "Other* category are those who sent requests at a college computer lab as instructed. 



As shown in Table 6-11, all but one of the participants who identified themselves as collaborators in the IPS 
(involved in a joint project with other people) reported that they shared information with other project members. 
In addition, some of those who identified themselves as originators (representing their own information need) 
shared information with other people. 
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SUMMARY 

This chapter reported study findings on situational factors associated with the use of the AskERIC Q&A Service 
and provided some answers to the research question RQ2: what situational factors do users perceive to be 
salient when they make requests of human intermediaries. 

User goals are structured in multiple levels as suggested by the goal model of Bandura's (1989) social cognitive 
theory in which a higher-level distal goal (IPS goal) generate lower-level immediate goals (goals of using the 
AskERIC Q&A Service). IPS goals are found to be associated with other dimensions of information needs 
including types of information sought, perceived importance of obtaining information, and inherent user biases. 

Provided that human IPS activities are goal-oriented, IPS processes themselves seem to be structured by the 
user goals. Processes of how such user goals were generated also found to be associated with users’ IPS 
behavior. Imposition of user goals accompanies with deadline, which generate time pressure. Social influence 
in generating user goals limits users’ freedom in IPS processes. Only those user goals generated by personal 
interests complete freedom of choices of topic and information sources. Limits of freedom in IPS processes 
generated from imposition and social influence may be associated with possible modifications of user goals 
or information needs. 

Users’ capacity is found to be associated with user goals. Clients of the AskERIC Q&A Service are likely to 
make requests as a student regardless of their primary occupations. It might be important to identify the 
capacity or users in their IPS processes, rather than primary occupation, in order to obtain a better understanding 
of their information needs. 
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CHAPTER 

SEVEN 



REASONS FOR 
USING THE 
AskERIC Q&A 
SERVICE 



This chapter presents the study’s findings on reasons articulated by participants for using the AskERIC Q&A 
Service and provides some additional answers to the research question RQ2: what situational factors do users 
perceive to be salient when they make requests of human intermediaries? The chapter first describes general 
patterns of associations among reasons observed at the global level. Through the analysis, unique patterns of 
relationships among reasons concerning the following three situational factors were identified: 

• Whether participants did self-searching before making requests of AskERIC, 

• Whether participants had experience in using the AskERIC Q&A Service and/or ERIC system, and 

• Different levels of participants’ perceived IPS skill. 

Thus, reasons peculiar to each group of the above three situational variables, as well as causal and temporal 
relationships of reasons within each group will also be described. 
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SHARED REASONS FOR USING THE ASKERIC Q&A SERVICE 

Participants articulated a variety of reasons for using the AskERIC Q&A Service for the IPS in response to Q12 1 
and elsewhere during the interview. Through content analysis of interview data, the study extracted on average 
5.2 different reasons per participant (ranged between 1 and 12 per participant). Table 7-1 presents reasons 
articulated by two or more participants 2 classified into six categories of situational factors. Definitions and 
examples of data instances of these reasons are presented in Appendix B3. 

As shown in Table 7-1, situational factors in all six categories were reported to have caused participants to 
select the service. Among them, C7: A POSITIVE IMAGE OF THE ASKERIC Q&A SERVICE was the major 
reason articulated by a majority of participants. 

CAUSAL AND TEMPORAL RELATIONSHIPS AMONG REASONS 

Reasons for using the AskERIC Q&A Service were found to have complex relationships within themselves. 
When participants articulated multiple reasons for using the AskERIC Q&A Service, they often used causal and 
temporal conjunctions. Thus, causal and temporal relationships among reasons for selecting the AskERIC Q&A 
Service were analyzed using a pattern coding technique recommended by Miles and Huberman (1994, p. 69) 
in order to identify shared patterns of relationships among reasons. Causal relationships between two reasons 
were identified by participants’ articulations of causal terms (e.g., because, so, since, etc.) and coded as "A^B," 
meaning REASON A caused REASON B. Temporal relationships were identified by participants’ articulations 
of temporal terms (e.g., when, then, after, as soon as, etc.) and coded as n A->B," meaning REASON A preceded 
REASON B. Whenever two or more participants articulated the same relationship between two identical 
reasons, the study captured it as a shared pattern of relationship between these two reasons. The coding results 
indicated that 21 reasons were complex reasons involved in causal and/or temporal relationships, while 19 
reasons were simple reasons independent of any causal/temporal relationship. Relationships identified between 
complex reasons, as well as simple reasons, are depicted in Figure 7-1. Complex reasons are located at the 
upper part of the graphic, while simple reasons are at the lower part of Figure 7-1. The distinction between 
simple and complex reasons is also provided in the last column of Figure 7-1. 



1 1nterview question 012 asked, "Please tell me what made you decide to use AskERIC to find the information this time." 

7 Reasons articulated by only one participant and not included in the table are: mediated-searching failure; negative image of self-searching; confidence in using the 
service; stealing time; money concern; vicarious-learning; top- site in Education/research category of a browser; IPS tasks should be delegated; federal sources are good; 
good name; own age is too old to learn self-searching. 
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Table 7-1: Reasons for Using the AskERIC Q&A Service (N=62) 



Category 


Properly 


Participants* 


Rank 


A.IPS PROCESSES 


A1 PLANNED USE 


3 


27 


A2 SELF-SEARCHING FAILURE 


23 


2 


A3 ENCOUNTER ASKERIC 


22 


2 


A4 HABITUAL USE 


7 


17 


A5 TRYING NEW SOURCE 


3 


27 


A6 EXHAUSTED SOURCES 


2 


37 


A7 ERIC SEARCH 


ii 


8 


A8 INTERNET SEARCH 


13 




B.INFORMATION NEEDS 


B1 NEED INFORMATION 


9 


14 


B2 VERIFY OWN SEARCH 


2 


37 


B3 NEED HELP IN IPS 


10 


12 


B4 TESTING SERVICE 


5 


21 


C.COGNITIVE STATES 


Cl KNOW ASKERIC 


2 


37 


C2 KNOW ERIC 


3 


27 


C3 LIMITED IPS SKILL 


12 


8 


C4 REMEMBER ASKERIC 


3 


27 


C5 REMEMBER ERIC 


4 


24 


C6 TOPIC/DOMAIN MATCHED 


12 


6 


C7 POSITIVE IMAGE OF ASKERIC 


35 




C8 POSITIVE IMAGE OF ERIC 


11 


8 


C9 NEGATIVE IMAGE OF LIBRARIES 


3 


27 


CIO NEGATIVE IMAGE OF INTERNET 


7 


17 


C11 LOGICAL CHOICE 


3 


27 


Cl 2 INTUITION 


2 


37 


DEFECTIVE STATES 


D1 FRUSTRATION OF SELF-SEARCHING 


8 


16 


D2 OPPORTUNISTIC HOPE 


11 


8 


D3 NOTHING TO LOSE 


3 


27 


E.SOCIAL CONTEXTS 


El IMPOSITION OF ASKERIC 


3 


27 


E2 IMPOSITION OF ERIC 


3 


27 


E3 GOOD EXPERIENCE ASKERIC 


13 


4 


E4 GOOD EXPERIENCE ERIC 


11 


8 


E5 GOOD EXPERIENCE WITH HUMAN INTERMEDIARY 


2 


37 


E6 HUMAN INFLUENCE ASKERIC 


9 


14 


E7 HUMAN INFLUENCE ERIC 


4 


24 


E8 REPUTATION OF ASKERIC 


5 


21 


E9 MEDIA INFLUENCE ASKERIC 


5 


21 


El 0 TIME LIMITATION 


7 


17 


F.ENVIRONMENTAL CONDITIONS 


FI CONVENIENCE 


10 


12 


F2 BOOKMARKED 


3 


27 


F3 ASKERIC AVAILABLE 


6 


20 


Average # of reasons’ 




320/62 = 5.2 





* The number in this column represents the number of participants who articulated each of the reasons (N=62). 

" Complex reasons are those that have a causal/temporal relationship with other reasons; simple reasons are those that have no such relationship. 
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This network represents complex associations among a variety of reasons for selecting the AskERIC Q&A 
Service. Three major clusters of associations of reasons in this network are: (1) centered around A3: 
ENCOUNTERING THE ASKERIC Q&A SERVICE; (2) centered around A2: SELF-SEARCHING FAILURE; and 0) 
centered around C7: A POSITIVE IMAGE OF THE ASKERIC Q&A SERVICE. Among them, the First two reasons 
are apparently associated with participants’ self-searching before sending requests to AskERIC. Thus, a variety 
of factors related to self-searching process (e.g., A2: SELF-SEARCHING FAILURE, Dl: FRUSTRATION WITH 
SELF-SEARCHING, and A3: ENCOUNTERING THE ASKERIC Q&A SERVICE) are reported to have causal 
relationships that led participants to use the service. The second cluster is not only related to the self-searching 
process, but also seems to be relevant to participants’ perceived levels of IPS skill , since it involved causal 
relationships with A2: SELF-SEARCHING FAILURE and B3: NEED FOR HELP IN IPS. 

On the other hand, the center of the third cluster, C7: A POSITIVE IMAGE OF THE ASKERIC Q&A SERVICE, was 
articulated by a majority of participants (33 or 36.3 %). Since a relatively large number of participants (11 or 17.7 
%) articulated the causal relationship between E3: GOOD EXPERIENCES OF USING THE ASKERIC Q&A SERVICE 
and C7: POSITIVE IMAGE OF THE SERVICE, this suggests that participants’ experiences in using the service (E3: 
GOOD EXPERIENCE ASKERIC) may be another source of the complexity of associations among reasons. 

CAUSAL RELATIONSHIPS AMONG CATEGORIES OF REASONS 

The causal relationships between reasons on the level of main categories of situational factors were analyzed. 
Table 7-2 presents causal relationships of reasons among six main categories of A: IPS PROCESS, B: 
INFORMATION NEEDS, C: COGNITIVE STATES, D: AFFECTIVE STATES, E: SOCIAL CONTEXTS, and F: 
ENVIRONMENTAL CONDITIONS. 



Table 7*2: Causal Relationship between Categories 



Relationship of Categories 


Causal Relationship Between Reasons 


A: IPS PROCESSES => B: INFO-NEED 


A2 SELF-SEARCHING FAILURE => B3 NEED HELP IN IPS 


C: COGNITIVE => A: IPS PROCESSES 


C3 LIMITED IPS SKILL => A2 SELF- SEARCHING FAILURE 




C7 POSITIVE IMAGE OF ASKERIC => A4 HABITUAL USE 




C9 NEGATIVE IMAGE OF LIBRARIES => A8 INTERNET SEARCH 


A: IPS PROCESS =>D: AFFECTIVE 


A2 SELF-SEARCHING FAILURE => Dl FRUSTRATION OF SELF-SEARCHING 


E: SOCIAL => A: IPS PROCESSES 


E2 IMPOSITION OF ERIC => A7 ERIC SEARCH 




E3 GOOD EXPERIENCE ASKERIC => A4 HABITUAL USE 




E4 GOOD EXPERIENCE ERIC => A7 ERIC SEARCH 




E7 HUMAN INFLUENCE ERIC => A7 ERIC SEARCH 


F: ENVIRONMENT => A: IPS PROCESSES 


FI CONVENIENCE => A8 INTERNET SEARCH 


C: COGNITIVE => B: INFO-NEED 


C3 LIMITATION OF IPS SKILL => B3 NEED HELP IN IPS 


C: COGNITIVE => D: AFFECTIVE 


C3 LIMITATION OF IPS SKILL => D2 OPPORTUNISTIC HOPE 


E: SOCIAL =>C: COGNITIVE 


E3 GOOD EXPERIENCE ASKERIC => C7 POSITIVE IMAGE OF ASKERIC 




E4 GOOD EXPERIENCE ERIC => C7 POSITIVE IMAGE OF ASKERIC 




E4 GOOD EXPERIENCE ERIC => C8 POSITIVE IMAGE OF ERIC 
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Table 7-2 describes, for example, reason A2 SELF-SEARCHING FAILURE under the category of A: IPS 
PROCESSES has a causal relationship with the reasons under the two categories of B: INFORMATION NEEDS 
(i.e., B3 NEED HELP IN IPS) and D: AFFECTIVE STATES (i.e., D1 FRUSTRATION OF SELF-SEARCHING). In 
addition, as shown in the Figure 7-1, reasons under all six categories are reported to have a direct causal 
relationship with participants’ selection of the AskERIC Q&A Service. Since the selection of the AskERIC Q&A 
Service is under the category of A: IPS PROCESSES, all five other categories have causal relations with it. 
Moreover, participants’ action of sending requests to the AskERIC Q&A Service eventually caused the AskERIC 
Q&A Service to receive the requests, and therefore, changed the social contexts. Thus, the causal relationship 
from A: IPS PROCESSES to E: SOCIAL CONTEXTS exists. These global relationships among six categories 
described above are presented in Figure 7-2. 



Figure 7-2: Relationships among Categories of Situational Factors 




Figure 7-2 suggests the following: 

• Bi-directional causal relationships are observed between A: IPS PROCESS and the three categories 
of B: INFORMATION NEEDS D: AFFECTIVE STATES, and E: SOCIAL CONTEXTS. 

• A uni-directional relationship is observed from the category of C: COGNITIVE STATES to the three 
categories of A: IPS PROCESS, B: INFORMATION NEEDS, and D: AFFECTIVE STATES, implying 
that cognitive states influence IPS processes not only directly but also indirectly through information 
needs and affective states. 
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• Uni-directional relationships are observed from the category of E: SOCIAL CONTEXTS to the category 
of C: COGNITIVE STATES, implying that social contexts influence IPS process not only directly but 
also indirectly through cognitive states. 

• A uni-directional relationship is observed from the category of F: ENVIRONMENTAL CONDITIONS 
to A: IPS PROCESSES, implying that environmental conditions influence IPS processes directly. 

• The category of F: ENVIRONMENTAL CONDITIONS does not receive causal influence from other 
categories of situational factors. 

Bandura’s (19 86) social cognitive theory assumes a triadic reciprocality between behavior, internal states, and 
external contexts, all interacting with each other, underlying human functioning. Such causal relationships 
assumed by the theory were, thus, partially identified on the micro level as causal relationships among reasons 
for selecting a particular human intermediation (i.e., the AskERIC Q&A Service). Though inconclusive, 
recognition of triadic reciprocal causal relationships among three factors in naturally occurring IPS processes 
as seen from users’ views implies the applicability of the social cognitive viewpoints to IPS processes. 

Figure 7-2 shows that both reasons under the category of A: IPS PROCESS that influenced other categories 
(A2: SELF-SEARCHING FAILURE and A3: ENCOUNTERED THE ASKERIC Q&A SERVICE) are relevant only to 
those participants who did self-searching before sending the requests . Thus, whether or not participants did 
self-searching before sending the requests may represent different patterns of causal relationships between 
reasons for selecting the service. Similarly, both reasons under the category of E: SOCIAL CONTEXTS (E3: 
GOOD EXPERIENCE OF THE ASKERIC Q&A SERVICE; and E 4: GOOD EXPERIENCE OF ERIC) are relevant 
only to those who had experience in using the AskERIC Q&A Service and/or the ERIC system. Thus, whether 
participants had experience in using the AskERIC Q&A Service and/or the ERIC system may represent different 
patterns of causal relationships between reasons for selecting the service. In addition, the reason under the 
category of C: COGNITIVE STATES that influenced two other categories of B: INFORMATION NEEDS and D: 
AFFECTIVE STATES is the C3: LIMITED IPS SKILL. Thus, the difference in levels of perceived IPS skill might 
represent different patterns of causal relationships of reasons. Since these three situational variables were also 
recognized as centers of three clusters in the causal and temporal network of reasons (Figure 7-1), the study 
further analyzed patterns of associations between these three variables and reasons for selecting the AskERIC 
Q&A Service: 

a. Whether participants did self-searching before making requests of AskERIC, 

b. Whether participants had experience in using the AskERIC Q&A Service and/or ERIC system, and 

c. Different levels of participants’ perceived IPS skill. 



The results of analysis are presented in the next sections. 
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Table 7-3: Association between Reasons and Self-searching before AskERIC (N=62) 



Whether Participant Did Self-searching 


HU 


■SSI 


im 


Category 


Code 


A: IPS PROCESSES 


A1 PLANNED USE 


2 


i 


3 


A2 SELF-SEARCHING FAILURE 


23 


0 


23 


A3 ENCOUNTER ASKERIC 


22 


0 


22 


A4 HABfTUAL USE 


5 


2 


7 


A5 TRYING NEW SOURCE 


2 


1 1 


3 


A6 EXHAUSTED SOURCES 


2 


0 


2 


A7 ERIC SEARCH 


11 


0 


11 


A8 INTERNET SEARCH 


13 


0 


13 


B: INFORMAT ION NEEDS 


B1 NEED INFORMATION 


8 


1 


9 


B2 VERIFY OWN SEARCH 


2 


0 


2 


B3 NEED HELP IN IPS 


8 


2 


10 


B4 TESTING SERVICE 


4 


1 


5 


C: COGNITIVE STATES 


Cl KNOW ASKERIC 


1 


1 


2 




C2 KNOW ERIC 


3 


0 


3 


C3 LIMITED IPS SKILL 


10 


2 


12 


C4 REMEMBER ASKERIC 


3 


0 


3 


C5 REMEMBER ERIC 


4 


0 


4 


C6 TOPIC/DOMAIN MATCHED 


ii 


1 


12 


C7 POSITIVE IMAGE OF ASKERIC 


28 


7 


35 


C8 POSITIVE IMAGE OF ERIC 


11 


0 


11 


C9 NEGATIVE IMAGE OF LIBRARIES 


2 


1 


3 


CIO NEGATIVE IMAGE OF INTERNET 


7 


0 


7 


Cl 1 LOGICAL CHOICE 


2 


1 


3 


Cl 2 INTUITION 


1 


1 


2 


D: AFFECTIVE STATES 


D1 FRUSTRATION OF SELF-SEARCHING 


8 


0 


8 


D2 OPPORTUNISTIC HOPE 


11 


0 


11 


D3 NOTHING TO LOSE 


3 


0 


3 


E: SOCIAL CONTEXTS 

l 


El IMPOSITION OF ASKERIC 


0 


3 


3 


E2 IMPOSITION OF ERIC 


2 


1 


3 


E3 GOOD EXPERIENCE ASKERIC 


8 


5 


13 


E4 GOOD EXPERIENCE ERIC 


11 


0 


11 


E5 GOOD EXPERIENCE WITH 
HUMAN INTERMEDIARY 


1 


1 

... 


2 


E6 HUMAN INFLUENCE ASKERIC 


5 


4 


9 


E7 HUMAN INFLUENCE ERIC 


4 


0 


4 


E8 REPUTATION ASKERIC 


5 


0 


5 


E9 MEDIA INFLUENCE ASKERIC 


2 


3 


5 


El 0 TIME LIMITATION 


6 


1 


7 


E: ENVIRON MENTAL CONDITIONS 


FI CONVENIENCE 


8 


2 


10 


F2 BOOKMARKED 


2 


1 


3 


F3 ASKERIC AVAILABLE 


6 


0 


6 


Average # of reasons 




276/48 = 5.8 


45/14 = 3.2 


320/62 = 5.2 



* Reasons identified as unique to those who did self- searching are shown in bold under this column. 

M Reasons identified as unique to those who did not perform setf*searching are shown in bold under this column. 
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Chapter 7: Reasons for Using the AskERIC Q&A Service 



SITUATIONAL FACTORS ASSOCIATED WITH 
SELF-SEARCHING BEFORE ASKERIC 

Reasons for using the AskERIC Q&A Service were analyzed for whether the participants did self-searching 
before sending the requests. In this analysis, participants were categorized into two groups: (al) those who 
did self-searching before sending the requests (n=48); and those who did not 01=14). Table 7-3 presents the 
number (over two) of participants in each group who reported each of the reasons for using the AskERIC 
Q&A Service. 

In Table 7-3, 17 reasons identified as unique to those who did self-searching are shown in bold under the 
column "al: Yes." And one reason as unique to those who did not perform self-searching is shown in bold 
under the column "a2: No." 

Table 7-3 also shows that participants who did self-searching (al) gave, on average, 5.8 reasons (ranges 
between 1 and 12 reasons per participant), while those who did not perform self-searching (a 2) gave, on 
average 3 2 (ranged between 1 and 6 reasons per participant). Thus, participants who did self-searching gave 
more reasons than those who did not, implying that a variety of situational factors in self-searching led them 
to use the service. 
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CAUSAL AND TEMPORAL RELATIONSHIP OF 
REASONS IN RELATION TO SELF-SEARCHING 

Table 7-4 presents causal and temporal relationships between pairs of reasons elicited from two or more 
participants for each of two groups of participants based on whether they did self-searching before sending 
requests. 



Table 7-4: Causal and Temporal Relationship between Reasons by Self-Searching (N=62) 



Whether Participant Did Self-searching 

Causal Relationship 




wEEM 


A2 SELF-SEARCHING FAILURE => B3 NEED HELP IN IPS 


5 


0 


A2 SELF-SEARCHING FAILURE => D1 FRUSTRATION OF SELF SEARCHING 


7 


0 


A3 ENCOUNTER ASKERIC => C4 REMEMBER ASKERIC 


2 


0 


A3 ENCOUNTER ASKERIC => C5 REMEMBER ERIC 


3 


0 


A3 ENCOUNTER ASKERIC D2 OPPORTUNISTIC HOPE 


10 


0 


A7 ERIC SEARCH -» A2 SELF-SEARCHING FAILURE 


7 


0 


A7 ERIC SEARCH -* A3 ENCOUNTER ASKERIC 


7 


0 


A8 INTERNET SEARCH A2 SELF-SEARCHING FAILURE 


6 


0 


A8 INTERNET SEARCH -» A3 ENCOUNTER ASKERIC 


8 


0 


C2 KNEW ERIC => C5 REMEMBER ERIC 


3 


0 


C3 LIMITATION OF IPS SKILL => A2 SELF-SEARCHING FAILURE 


2 


0 


C3 LIMITATION OF IPS SKILL => B3 NEED HELP IN IPS 


3 


2 


C3 LIMITATION OF IPS SKILL => C7 POSITIVE IMAGE OF ASKERIC 


3 


1 


C3 LIMITATION OF IPS SKILL => D2 OPPORTUNISTIC HOPE 


2 


0 


C7 POSITIVE IMAGE OF ASKERIC => A4 HABITUAL USE 


3 


1 


C8 POSITIVE IMAGE OF ERIC => C7 POSITIVE IMAGE OF ASKERIC 




0 


C9 NEGATIVE IMAGE OF LIBRARIES => A8 INTERNET SEARCH 


2 


0 


CIO NEGATIVE IMAGE OF INTERNET => C7 POSITIVE IMAGE OF ASKERIC 


6 




E2 IMPOSITION OF ERIC => A7 ERIC SEARCH 


2 


0 


E3 GOOD EXPERIENCE ASKERIC => A4 HABITUAL USE 


3 


1 


E3 GOOD EXPERIENCE ASKERIC => C7 POSITIVE IMAGE OF ASKERIC 


7 


4 


E4 GOOD EXPERIENCE ERIC => A7 ERIC SEARCH 


3 . 


0 


E4 GOOD EXPERIENCE ERIC => C7 POSITIVE IMAGE OF ASKERIC 


2 


0 


E4 GOOD EXPERIENCE ERIC => C8 POSITIVE IMAGE OF ERIC 


5 


0 


E7 HUMAN INFLUENCE ERIC => A7 ERIC SEARCH 


4 


0 


FI CONVENIENCE => A8 INTERNET SEARCH 


3 


0 



As shown in Table 7-4, all causal and temporal relationships articulated by two or more participants are also 
identified among participants who did self-searching (al). Only five causal relationships are identified among 
those who did not perform self-searching (a2). Thus, causal and temporal relationships of reasons in selecting 
the AskERIC Q&A Service are more complex for those who did self- searching (al) than those who did not 
perform self-searching prior to using AskERIC. 
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